Jul 02 04:35:35 devstack cinder-volume[75285]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 04:35:35 devstack cinder-volume[75285]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 04:35:35 devstack cinder-volume[75285]: we strongly recommend against using it for new projects.
Jul 02 04:35:35 devstack cinder-volume[75285]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 04:35:35 devstack cinder-volume[75285]: framework.  For more detail see
Jul 02 04:35:35 devstack cinder-volume[75285]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 04:35:35 devstack cinder-volume[75285]:   import eventlet  # noqa
Jul 02 04:35:38 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:35:38 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:35:38 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:35:39 devstack cinder-volume[75285]: INFO dbcounter [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Registered counter for database cinder
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG dbcounter [-] [75285] Writer thread running {{(pid=75285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:35:39 devstack cinder-volume[75285]: INFO cinder.rpc [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 04:35:39 devstack cinder-volume[75285]: INFO cinder.rpc [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:35:39 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Determined volume DB was empty at startup.
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG cinder.volume.manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75285) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 04:35:39 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 02 04:35:39 devstack cinder-volume[75285]: WARNING stevedore.named [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 04:35:39 devstack cinder-volume[75285]: WARNING castellan.key_manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:35:39 devstack cinder-volume[75285]: WARNING cinder.keymgr.conf_key_mgr [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG cinder.volume.drivers.lvm [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75285) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 02 04:35:39 devstack cinder-volume[75285]: DEBUG oslo_concurrency.processutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_concurrency.processutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:35:40 devstack cinder-volume[75285]: INFO cinder.rpc [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 02 04:35:40 devstack cinder-volume[75285]: INFO cinder.rpc [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 02 04:35:40 devstack cinder-volume[75285]: WARNING stevedore.named [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 04:35:40 devstack cinder-volume[75285]: WARNING castellan.key_manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:35:40 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:35:40 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Starting 1 workers
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Started child 75453 {{(pid=75285) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Full set of CONF: {{(pid=75285) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Configuration options gathered from: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] ================================================================================ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] allow_availability_zone_fallback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] allow_compression_on_image_upload = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] allowed_direct_url_schemes     = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] api_rate_limit                 = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] auth_strategy                  = keystone {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] az_cache_duration              = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_availability_zone      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_host                   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_name                   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_stats_polling_interval = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backup_api_class               = cinder.backup.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backup_name_template           = backup-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backup_use_same_host           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backup_use_temp_snapshot       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] chap_password                  = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] chap_username                  =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_internal_tenant_project_id = d9ee67ee407f427fbc035a2e7f2b1f36 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_internal_tenant_user_id = f1dd9a636a2b48a9a991062f6c9b6a25 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cloned_volume_same_az          = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cluster                        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] compression_format             = gzip {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] config_dir                     = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] config_source                  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] control_exchange               = openstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] debug                          = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] default_availability_zone      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] default_group_type             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] default_volume_type            = lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] disk_geometry                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_client_cert             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_client_cert_key         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_data_namespace          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_ssl_cert_path           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_ssl_cert_verify         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] driver_use_ssl                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] enable_force_upload            = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] enable_new_services            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] enable_unsupported_driver      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] enforce_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] filter_function                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_api_insecure            = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_api_ssl_compression     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_ca_certificates_file    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_num_retries             = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance_request_timeout         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] goodness_function              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] graceful_shutdown_timeout      = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] group_api_class                = cinder.group.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] host                           = devstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_compress_on_upload       = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_conversion_address_space_limit = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_conversion_cpu_limit     = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_conversion_disable       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_upload_use_cinder_backend = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_upload_use_internal_tenant = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_volume_cache_enabled     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_volume_cache_max_count   = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] init_host_max_objects_retrieval = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iscsi_target_flags             =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iscsi_write_cache              = on {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iser_helper                    = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iser_ip_address                = 192.168.122.169 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iser_port                      = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_color                      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_config_append              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_dir                        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_file                       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_options                    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_rotate_interval            = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_rotate_interval_type       = days {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] log_rotation_type              = none {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] max_age                        = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] max_logfile_count              = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] max_logfile_size_mb            = 200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] max_over_subscription_ratio    = 20.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] message_reap_interval          = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] message_ttl                    = 2592000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] monkey_patch                   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] monkey_patch_modules           = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] my_ip                          = 192.168.122.169 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] no_snapshot_gb_quota           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] num_iser_scan_tries            = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] num_shell_tries                = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] num_volume_device_scan_tries   = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] nvmeof_conn_info_version       = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] nvmet_ns_id                    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] nvmet_port_id                  = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_max_limit                = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_ext_list          = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_listen_port       = 8776 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_use_ssl           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] osapi_volume_workers           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] per_volume_size_limit          = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] periodic_fuzzy_delay           = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] periodic_interval              = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] public_endpoint                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] publish_errors                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_backup_gigabytes         = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_backups                  = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_gigabytes                = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_groups                   = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_snapshots                = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] quota_volumes                  = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] rate_limit_burst               = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] rate_limit_except_level        = CRITICAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] rate_limit_interval            = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] reinit_driver_count            = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] replication_device             = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] report_discard_supported       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] report_interval                = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] reservation_clean_interval     = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] reservation_expire             = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] reserved_image_namespaces      = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] reserved_percentage            = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] rpc_response_timeout           = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] run_external_periodic_tasks    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] scst_target_driver             = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] scst_target_iqn_name           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_down_time              = 720 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] shell_completion               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] snapshot_name_template         = snapshot-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] snapshot_same_host             = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] split_loggers                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] state_path                     = /opt/stack/data/cinder {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] storage_availability_zone      = nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] storage_protocol               = iSCSI {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] syslog_log_facility            = LOG_USER {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_helper                  = lioadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_ip_address              = 192.168.122.169 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_port                    = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_protocol                = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] target_secondary_ip_addresses  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] trace_flags                    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] transport_url                  = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] until_refresh                  = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_chap_auth                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_default_quota_class        = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_journal                    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_json                       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_multipath_for_image_xfer   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_stderr                     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] use_syslog                     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] verify_glance_signatures       = enabled {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_api_class               = cinder.volume.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_backend_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_clear                   = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_clear_ionice            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_clear_size              = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_copy_bps_limit          = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_dd_blocksize            = 1M {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_name_template           = volume-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_service_inithost_offload = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volume_usage_audit_period      = month {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] zoning_mode                    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.auth_type   = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.auth_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.cache       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.certfile    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.insecure    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.interface   = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.keyfile     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_password =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack sudo[75457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcache_username =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.region_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack sudo[75457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.service_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.backend                  = dogpile.cache.null {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.backend_argument         = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.backend_expiration_time  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.config_prefix            = cache.oslo {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.debug_cache_backend      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.enable_retry_client      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.enable_socket_keepalive  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.enabled                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.expiration_time          = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_dead_retry      = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_sasl_enabled    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.password                 = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.proxies                  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.redis_db                 = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.redis_server             = localhost:6379 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.retry_attempts           = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.retry_delay              = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.socket_keepalive_count   = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.socket_keepalive_idle    = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.socket_keepalive_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.socket_timeout           = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.tls_allowed_ciphers      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.tls_cafile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.tls_certfile             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.tls_enabled              = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.tls_keyfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cache.username                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] coordination.backend_url       = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.asyncio_connection    = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.asyncio_slave_connection = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.backend               = sqlalchemy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.connection            = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.connection_debug      = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.connection_parameters =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.connection_recycle_time = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.connection_trace      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.db_inc_retry_interval = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.db_max_retries        = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.db_max_retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.db_retry_interval     = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.max_overflow          = 50 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.max_pool_size         = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.max_retries           = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.pool_timeout          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.retry_interval        = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.slave_connection      = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.sqlite_synchronous    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.synchronous_reader    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] database.use_db_reconnect      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.connection_string     = messaging:// {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.enabled               = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.es_doc_type           = notification {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.es_scroll_size        = 10000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.es_scroll_time        = 2m {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.filter_error_trace    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.hmac_keys             = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.sentinel_service_name = mymaster {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.socket_timeout        = 0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.trace_requests        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler.trace_sqlalchemy      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler_jaeger.process_tags   = {} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] profiler_otlp.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.enforce_new_defaults = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.enforce_scope      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.policy_default_rule = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.group          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] privsep_osbrick.user           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.group         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] cinder_sys_admin.user          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.auth_section      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.auth_type         = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.cafile            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.certfile          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.collect_timing    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.insecure          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.keyfile           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.send_service_user_token = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.split_loggers     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] service_user.timeout           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.auth_section            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.auth_type               = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.collect_timing          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.region_name             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.split_loggers           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] glance.timeout                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.backend_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.chap_password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.chap_username =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.disk_geometry = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_client_cert = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_data_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.driver_use_ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.extra_capabilities = {} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.filter_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.goodness_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iscsi_target_flags =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iser_port     = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.lvm_share_target = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.lvm_type      = auto {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.replication_device = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.report_discard_supported = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_helper = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_port   = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_protocol = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.trace_flags   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.use_chap_auth = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_backend_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_clear  = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_reports.file_event_handler = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_reports.log_dir           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.backend_host       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.chap_password      = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.chap_username      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.disk_geometry      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.filter_function    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.goodness_function  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iser_helper        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iser_port          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.lvm_type           = auto {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.replication_device = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.storage_protocol   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_ip_address  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_port        = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.trace_flags        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_clear       = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] lvmdriver-1.volumes_dir        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_notifications.driver = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] key_manager.fixed_key          = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.barbican_api_version  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.barbican_endpoint     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.barbican_endpoint_type = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.barbican_region_name  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.cafile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.certfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.collect_timing        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.insecure              = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.keyfile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.number_of_retries     = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.retry_delay           = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.send_service_user_token = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.split_loggers         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.timeout               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.verify_ssl            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican.verify_ssl_path       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.auth_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.cafile   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.keyfile  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] barbican_service_user.timeout  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.approle_role_id          = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.approle_secret_id        = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.kv_mountpoint            = secret {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.kv_path                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.kv_version               = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.namespace                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.root_token_id            = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.ssl_ca_crt_file          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.timeout                  = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.use_ssl                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:35:40 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 04:35:41 devstack sudo[75457]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:41 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:41 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:41 devstack sudo[75563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:41 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:42 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.684s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:35:42 devstack cinder-volume[75453]: INFO cinder.brick.local_dev.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:42 devstack sudo[75793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:42 devstack sudo[75793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:42 devstack sudo[75793]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG cinder.brick.local_dev.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75453) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 02 04:35:42 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:42 devstack sudo[76023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:42 devstack sudo[76023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:44 devstack sudo[76023]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.292s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:44 devstack sudo[76196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:44 devstack sudo[76196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:44 devstack sudo[76196]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:44 devstack sudo[76235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 02 04:35:44 devstack sudo[76235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:45 devstack sudo[76235]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.651s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:45 devstack sudo[76245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:45 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:46 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:46 devstack sudo[76254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:46 devstack sudo[76254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:47 devstack sudo[76254]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:47 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:47 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:47 devstack sudo[76260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:47 devstack sudo[76260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:48 devstack sudo[76260]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.859s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:48 devstack sudo[76271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:48 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:48 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:48 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:48 devstack sudo[76275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:48 devstack sudo[76275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:49 devstack sudo[76275]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:49 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:49 devstack cinder-volume[75453]: INFO cinder.volume.drivers.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 02 04:35:49 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:49 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:49 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:49 devstack sudo[76285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:49 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:50 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:50 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.745s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:50 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:35:50 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:50 devstack sudo[76402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:50 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:50 devstack cinder-volume[75285]: DEBUG dbcounter [-] [75285] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:35:50 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:50 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:50 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:50 devstack sudo[76543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:50 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:51 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:51 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:51 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:51 devstack sudo[76548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:51 devstack sudo[76548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:52 devstack sudo[76548]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:52 devstack sudo[76551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:52 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:52 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:52 devstack cinder-volume[75453]: INFO cinder.volume.driver [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG cinder.volume.driver [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75453) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG oslo_db.sqlalchemy.engines [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writer thread running {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG cinder.db.api [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Building query based on filter {{(pid=75453) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG cinder.image.image_utils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75453) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 04:35:52 devstack cinder-volume[75453]: INFO cinder.keymgr.migration [None req-e63d33c6-ce17-4f37-9fe0-18e4ec708f79 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:35:52 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:52 devstack sudo[76555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:52 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:53 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:53 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:53 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:53 devstack sudo[76562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:53 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:54 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:54 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:54 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:54 devstack sudo[76565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:54 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:54 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:54 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:54 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:54 devstack sudo[76569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:54 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:55 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:35:55 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Driver initialization completed successfully.
Jul 02 04:35:55 devstack cinder-volume[75453]: INFO cinder.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Initiating service 2 cleanup
Jul 02 04:35:55 devstack cinder-volume[75453]: INFO cinder.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Service 2 cleanup completed.
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG cinder.service [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Creating RPC server for service cinder-volume {{(pid=75453) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG cinder.service [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75453) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 04:35:55 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:35:55 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:55 devstack sudo[76572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:35:55 devstack sudo[76572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:56 devstack sudo[76572]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:56 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:56 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:56 devstack sudo[76576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:56 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:57 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:57 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:57 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:57 devstack sudo[76582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:35:57 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:57 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:57 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:57 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:35:57 devstack sudo[76639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:35:57 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:35:58 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root
Jul 02 04:35:58 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:35:58 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-0aa976dc-931c-4a48-a43c-644205708e60 None None] Driver post RPC initialization completed successfully.
Jul 02 04:36:08 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:36:08 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:36:44 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:36:44 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:36:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:36:44 devstack sudo[78247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:36:44 devstack sudo[78247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:36:44 devstack sudo[78247]: pam_unix(sudo:session): session closed for user root
Jul 02 04:36:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:36:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:36:45 devstack sudo[78253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:36:45 devstack sudo[78253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:36:45 devstack sudo[78253]: pam_unix(sudo:session): session closed for user root
Jul 02 04:36:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:36:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:36:45 devstack sudo[78259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:36:45 devstack sudo[78259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:36:46 devstack sudo[78259]: pam_unix(sudo:session): session closed for user root
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:36:46 devstack sudo[78262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:36:46 devstack sudo[78262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:36:46 devstack sudo[78262]: pam_unix(sudo:session): session closed for user root
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:36:46 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] thread info: [<_MainThread(MainThread, started 128798499614848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128798389665728)>, <Thread(Thread-3 (stat_writer), started daemon 128798392294464)>, <Thread(Rabbit-heartbeat, started daemon 128798387379328)>, <Thread(Thread-5 (_runner), started daemon 128798387543744)>, <Thread(Thread-7 (_runner), started daemon 128798385525312)>] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:37:44 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:37:44 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:37:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:37:44 devstack sudo[81509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:37:44 devstack sudo[81509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:37:45 devstack sudo[81509]: pam_unix(sudo:session): session closed for user root
Jul 02 04:37:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:37:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:37:45 devstack sudo[81512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:37:45 devstack sudo[81512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:37:45 devstack sudo[81512]: pam_unix(sudo:session): session closed for user root
Jul 02 04:37:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:37:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:37:45 devstack sudo[81521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:37:45 devstack sudo[81521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:37:46 devstack sudo[81521]: pam_unix(sudo:session): session closed for user root
Jul 02 04:37:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:37:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:37:46 devstack sudo[81524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:37:46 devstack sudo[81524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:37:46 devstack sudo[81524]: pam_unix(sudo:session): session closed for user root
Jul 02 04:37:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:37:46 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:38:08 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:38:08 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:38:44 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:38:44 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:38:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:38:44 devstack sudo[83361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:38:44 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:38:45 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root
Jul 02 04:38:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:38:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:38:45 devstack sudo[83373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:38:45 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:38:45 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root
Jul 02 04:38:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:38:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:38:45 devstack sudo[83402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:38:45 devstack sudo[83402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:38:46 devstack sudo[83402]: pam_unix(sudo:session): session closed for user root
Jul 02 04:38:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:38:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:38:46 devstack sudo[83417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:38:46 devstack sudo[83417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:38:47 devstack sudo[83417]: pam_unix(sudo:session): session closed for user root
Jul 02 04:38:47 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:38:47 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:38:47 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:38:47 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:38:47 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] thread info: [<_MainThread(MainThread, started 128798499614848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128798389665728)>, <Thread(Thread-3 (stat_writer), started daemon 128798392294464)>, <Thread(Rabbit-heartbeat, started daemon 128798387379328)>, <Thread(Thread-5 (_runner), started daemon 128798387543744)>, <Thread(Thread-7 (_runner), started daemon 128798385525312)>] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:39:44 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:39:44 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 02 04:39:44 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:39:44 devstack sudo[84691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 02 04:39:44 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:39:45 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root
Jul 02 04:39:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:39:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:39:45 devstack sudo[84702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:39:45 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:39:45 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root
Jul 02 04:39:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:39:45 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:39:45 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 02 04:39:45 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:39:46 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Jul 02 04:39:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:39:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:39:46 devstack sudo[84726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 02 04:39:46 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:39:46 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root
Jul 02 04:39:46 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:39:46 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-24f27ae0-073c-468e-96a0-9475ea0165f4 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:40:08 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:40:17 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Caught SIGTERM, stopping children
Jul 02 04:40:17 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Acquiring lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:17 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Acquired lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:17 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Releasing lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:17 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Stop services. {{(pid=75285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 02 04:40:17 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Killing children. {{(pid=75285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 02 04:40:17 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Waiting on 1 children to exit
Jul 02 04:40:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Acquiring lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Acquired lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Releasing lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:20 devstack cinder-volume[75453]: WARNING amqp [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 04:40:20 devstack cinder-volume[75453]: WARNING amqp [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 04:40:20 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-32fd2cb5-6052-441b-8469-38e439fd16f5 None None] Child 75453 exited with status 0
Jul 02 04:40:21 devstack cinder-volume[85501]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 04:40:21 devstack cinder-volume[85501]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 04:40:21 devstack cinder-volume[85501]: we strongly recommend against using it for new projects.
Jul 02 04:40:21 devstack cinder-volume[85501]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 04:40:21 devstack cinder-volume[85501]: framework.  For more detail see
Jul 02 04:40:21 devstack cinder-volume[85501]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 04:40:21 devstack cinder-volume[85501]:   import eventlet  # noqa
Jul 02 04:40:23 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:23 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:23 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:23 devstack cinder-volume[85501]: INFO dbcounter [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Registered counter for database cinder
Jul 02 04:40:23 devstack cinder-volume[85501]: DEBUG oslo_db.sqlalchemy.engines [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG dbcounter [-] [85501] Writer thread running {{(pid=85501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO cinder.rpc [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO cinder.rpc [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_db.sqlalchemy.engines [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Determined volume DB was empty at startup.
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG cinder.volume.manager [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85501) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 02 04:40:24 devstack cinder-volume[85501]: WARNING stevedore.named [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 04:40:24 devstack cinder-volume[85501]: WARNING castellan.key_manager [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:40:24 devstack cinder-volume[85501]: WARNING cinder.keymgr.conf_key_mgr [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_db.sqlalchemy.engines [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:24 devstack cinder-volume[85501]: INFO oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Starting 1 workers
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Started child 85717 {{(pid=85501) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Full set of CONF: {{(pid=85501) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] ******************************************************************************** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Configuration options gathered from: {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] ================================================================================ {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] allow_availability_zone_fallback = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] allow_compression_on_image_upload = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] allowed_direct_url_schemes     = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] api_rate_limit                 = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] auth_strategy                  = keystone {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_availability_zone      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_host                   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_name                   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_stats_polling_interval = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85717]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backup_api_class               = cinder.backup.api.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backup_name_template           = backup-%s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backup_use_same_host           = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backup_use_temp_snapshot       = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] chap_password                  = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] chap_username                  =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_internal_tenant_project_id = d9ee67ee407f427fbc035a2e7f2b1f36 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_internal_tenant_user_id = f1dd9a636a2b48a9a991062f6c9b6a25 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cluster                        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] compression_format             = gzip {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] config_dir                     = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] config_source                  = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] control_exchange               = openstack {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] debug                          = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] default_availability_zone      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] default_group_type             = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] default_volume_type            = QuobyteHD {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] disk_geometry                  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_client_cert             = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_client_cert_key         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_data_namespace          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_ssl_cert_path           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_ssl_cert_verify         = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] driver_use_ssl                 = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] enable_new_services            = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] enable_unsupported_driver      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] enforce_multipath_for_image_xfer = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] filter_function                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_api_insecure            = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_api_ssl_compression     = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_ca_certificates_file    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_certfile                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_keyfile                 = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_num_retries             = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance_request_timeout         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] goodness_function              = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] graceful_shutdown_timeout      = 5 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] group_api_class                = cinder.group.api.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] host                           = devstack {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_compress_on_upload       = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_conversion_address_space_limit = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_conversion_cpu_limit     = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_conversion_disable       = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_upload_use_cinder_backend = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_upload_use_internal_tenant = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_volume_cache_enabled     = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_volume_cache_max_count   = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] image_volume_cache_max_size_gb = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] init_host_max_objects_retrieval = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iscsi_target_flags             =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iscsi_write_cache              = on {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iser_helper                    = tgtadm {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iser_ip_address                = 192.168.122.169 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iser_port                      = 3260 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_color                      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_config_append              = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_dir                        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_file                       = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_options                    = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_rotate_interval            = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_rotate_interval_type       = days {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] log_rotation_type              = none {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] max_age                        = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] max_logfile_count              = 30 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] max_logfile_size_mb            = 200 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] max_over_subscription_ratio    = 20.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] message_reap_interval          = 86400 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] message_ttl                    = 2592000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] migration_create_volume_timeout_secs = 300 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] monkey_patch                   = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.remotefs [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85717) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] monkey_patch_modules           = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] my_ip                          = 192.168.122.169 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] no_snapshot_gb_quota           = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] num_iser_scan_tries            = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] num_shell_tries                = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] num_volume_device_scan_tries   = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] nvmeof_conn_info_version       = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] nvmet_ns_id                    = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] nvmet_port_id                  = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_max_limit                = 1000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_ext_list          = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_listen_port       = 8776 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_use_ssl           = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] osapi_volume_workers           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] per_volume_size_limit          = -1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] periodic_fuzzy_delay           = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] periodic_interval              = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] public_endpoint                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] publish_errors                 = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_backup_gigabytes         = 1000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_backups                  = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_gigabytes                = 1000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_groups                   = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_snapshots                = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] quota_volumes                  = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] rate_limit_burst               = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] rate_limit_except_level        = CRITICAL {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] rate_limit_interval            = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] reinit_driver_count            = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] replication_device             = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] report_discard_supported       = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] report_interval                = 120 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] reservation_clean_interval     = 86400 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] reservation_expire             = 86400 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] reserved_image_namespaces      = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] reserved_percentage            = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] rpc_response_timeout           = 120 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] run_external_periodic_tasks    = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] scst_target_driver             = iscsi {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] scst_target_iqn_name           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_down_time              = 720 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] shell_completion               = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] snapshot_name_template         = snapshot-%s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] split_loggers                  = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] state_path                     = /opt/stack/data/cinder {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] storage_availability_zone      = nova {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] storage_protocol               = iSCSI {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] syslog_log_facility            = LOG_USER {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_helper                  = lioadm {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_ip_address              = 192.168.122.169 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_port                    = 3260 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_protocol                = iscsi {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] target_secondary_ip_addresses  = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] trace_flags                    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] transport_url                  = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] until_refresh                  = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_chap_auth                  = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_default_quota_class        = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_journal                    = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_json                       = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_multipath_for_image_xfer   = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_stderr                     = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] use_syslog                     = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] verify_glance_signatures       = enabled {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_api_class               = cinder.volume.api.API {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_backend_name            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_clear                   = zero {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_clear_ionice            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_clear_size              = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_copy_bps_limit          = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_dd_blocksize            = 1M {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_name_template           = volume-%s {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_service_inithost_offload = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volume_usage_audit_period      = month {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] zoning_mode                    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_concurrency.disable_process_locking = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.auth_section = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.auth_type   = password {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.auth_version = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.cache       = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.certfile    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.include_service_catalog = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.insecure    = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.interface   = public {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.keyfile     = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_password =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcache_username =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.region_name = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.service_type = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.backend                  = dogpile.cache.null {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.backend_argument         = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.backend_expiration_time  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.config_prefix            = cache.oslo {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.debug_cache_backend      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.enable_retry_client      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.enable_socket_keepalive  = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.enabled                  = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.expiration_time          = 600 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.hashclient_retry_attempts = 2 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_dead_retry      = 300 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_sasl_enabled    = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.password                 = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85717) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 02 04:40:24 devstack cinder-volume[85717]: WARNING cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 02 04:40:24 devstack cinder-volume[85717]: WARNING cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.proxies                  = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.redis_db                 = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Running cmd (subprocess): mount.quobyte {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.redis_server             = localhost:6379 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.retry_attempts           = 2 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.retry_delay              = 0.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.socket_keepalive_count   = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.socket_keepalive_idle    = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.socket_keepalive_interval = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.socket_timeout           = 1.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.tls_allowed_ciphers      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.tls_cafile               = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.tls_certfile             = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.tls_enabled              = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.tls_keyfile              = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cache.username                 = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] coordination.backend_url       = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.asyncio_connection    = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.asyncio_slave_connection = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.backend               = sqlalchemy {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.connection            = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.connection_debug      = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.connection_parameters =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.connection_recycle_time = 3600 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.connection_trace      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.db_inc_retry_interval = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.db_max_retries        = 20 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.db_max_retry_interval = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.db_retry_interval     = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.max_overflow          = 50 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.max_pool_size         = 5 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.max_retries           = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.mysql_wsrep_sync_wait = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.pool_timeout          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.retry_interval        = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.slave_connection      = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.sqlite_synchronous    = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.synchronous_reader    = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] database.use_db_reconnect      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.connection_string     = messaging:// {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.enabled               = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.es_doc_type           = notification {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.es_scroll_size        = 10000 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.es_scroll_time        = 2m {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.filter_error_trace    = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.hmac_keys             = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.sentinel_service_name = mymaster {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.socket_timeout        = 0.1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.trace_requests        = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler.trace_sqlalchemy      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler_jaeger.process_tags   = {} {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler_jaeger.service_name_prefix = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] profiler_otlp.service_name_prefix = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.enforce_new_defaults = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.enforce_scope      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.policy_default_rule = default {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.group          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.helper_command = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] privsep_osbrick.user           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.group         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.helper_command = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] cinder_sys_admin.user          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.auth_section      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.auth_type         = password {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.cafile            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.certfile          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.collect_timing    = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.insecure          = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.keyfile           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.send_service_user_token = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.split_loggers     = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] service_user.timeout           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.auth_section            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.auth_type               = password {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.certfile                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.collect_timing          = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.insecure                = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.keyfile                 = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.region_name             = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.split_loggers           = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] glance.timeout                 = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.backend_availability_zone = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.chap_password = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.chap_username =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.disk_geometry = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_client_cert = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_client_cert_key = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_data_namespace = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.driver_use_ssl = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.extra_capabilities = {} {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.filter_function = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.goodness_function = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iscsi_target_flags =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iscsi_write_cache = on {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iser_port     = 3260 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_host      =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_login     = admin {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_mount_options = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack quobyte-client[85722]: Reading configuration file: /etc/quobyte/client.cfg
Jul 02 04:40:24 devstack quobyte-client[85722]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_password  = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_private_key =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_share_path =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.num_shell_tries = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: INFO cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e ...
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 -c /etc/quobyte/client-cinder.cfg {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.quobyte_volume_url = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.replication_device = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.report_discard_supported = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.reserved_percentage = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_helper = tgtadm {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_port   = 3260 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_protocol = iscsi {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.trace_flags   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.unique_fqdn_network = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.use_chap_auth = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_backend_name = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_clear  = zero {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_clear_ionice = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_clear_size = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_reports.file_event_handler = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_reports.log_dir           = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.backend_availability_zone = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.backend_host         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.chap_password        = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.chap_username        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.disk_geometry        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_client_cert   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack sudo[85723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 -c /etc/quobyte/client-cinder.cfg
Jul 02 04:40:24 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_data_namespace = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.extra_capabilities   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.filter_function      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.goodness_function    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iser_helper          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iser_ip_address      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iser_port            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_host             = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_login            = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_mount_options    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_password         = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_private_key      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_share_path       = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:24 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.num_shell_tries      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.replication_device   = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.report_discard_supported = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.reserved_percentage  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.scst_target_driver   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.storage_protocol     = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_helper        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_ip_address    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_port          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_prefix        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_protocol      = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.trace_flags          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.use_chap_auth        = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_clear         = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_clear_size    = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] QuobyteHD.volumes_dir          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_notifications.driver = [] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_notifications.retry = -1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] key_manager.fixed_key          = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.barbican_api_version  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.barbican_endpoint     = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.barbican_endpoint_type = public {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.barbican_region_name  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.cafile                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.certfile              = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.collect_timing        = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.insecure              = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.keyfile               = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.number_of_retries     = 60 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.retry_delay           = 1 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.send_service_user_token = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.split_loggers         = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.timeout               = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.verify_ssl            = True {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican.verify_ssl_path       = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.auth_section = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.auth_type = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.cafile   = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.certfile = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.collect_timing = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.insecure = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.keyfile  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.split_loggers = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] barbican_service_user.timeout  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.approle_role_id          = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.approle_secret_id        = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.kv_mountpoint            = secret {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.kv_path                  = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.kv_version               = 2 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.namespace                = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.root_token_id            = **** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.ssl_ca_crt_file          = None {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.timeout                  = 60.0 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.use_ssl                  = False {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:25 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] ******************************************************************************** {{(pid=85501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 04:40:25 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:25 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.824s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:25 devstack cinder-volume[85717]: INFO cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e succeeded
Jul 02 04:40:25 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:25 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.837s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:25 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:25 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:25 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:26 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.922s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:26 devstack cinder-volume[85717]: INFO cinder.volume.driver [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG cinder.volume.driver [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85717) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG oslo_db.sqlalchemy.engines [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG dbcounter [-] [85717] Writer thread running {{(pid=85717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG cinder.db.api [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Building query based on filter {{(pid=85717) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 04:40:26 devstack cinder-volume[85717]: DEBUG cinder.image.image_utils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85717) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 04:40:26 devstack cinder-volume[85717]: INFO cinder.keymgr.migration [None req-baa73e75-78d9-48d0-a599-a8ab54eb6e0c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:27 devstack sudo[85914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:27 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:27 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:27 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.957s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG cinder.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Notifying Schedulers of capabilities ... {{(pid=85717) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:40:28 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Driver initialization completed successfully.
Jul 02 04:40:28 devstack cinder-volume[85717]: INFO cinder.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Initiating service 3 cleanup
Jul 02 04:40:28 devstack cinder-volume[85717]: INFO cinder.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Service 3 cleanup completed.
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG cinder.service [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Creating RPC server for service cinder-volume {{(pid=85717) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG cinder.service [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85717) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 04:40:28 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=85717) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG cinder.volume.drivers.quobyte [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=85717) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85717) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:28 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:28 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:28 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:29 devstack cinder-volume[85501]: INFO oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Caught SIGTERM, stopping children
Jul 02 04:40:29 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Acquiring lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:29 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Acquired lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:29 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Releasing lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:29 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Stop services. {{(pid=85501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 02 04:40:29 devstack cinder-volume[85501]: DEBUG oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Killing children. {{(pid=85501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 02 04:40:29 devstack cinder-volume[85501]: INFO oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Waiting on 1 children to exit
Jul 02 04:40:29 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:29 devstack cinder-volume[85717]: DEBUG oslo_concurrency.processutils [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.154s {{(pid=85717) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:29 devstack cinder-volume[85717]: INFO cinder.volume.manager [None req-402279df-4ef0-4f3a-8b1c-970e0d01a1ec None None] Driver post RPC initialization completed successfully.
Jul 02 04:40:30 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Acquiring lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:30 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Acquired lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:30 devstack cinder-volume[85717]: DEBUG oslo_concurrency.lockutils [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Releasing lock "singleton_lock" {{(pid=85717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:30 devstack cinder-volume[85717]: WARNING amqp [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 04:40:30 devstack cinder-volume[85717]: WARNING amqp [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 02 04:40:30 devstack cinder-volume[85501]: INFO oslo_service.backend._eventlet.service [None req-98ed557a-d6de-48f1-bca9-6a6052bbec14 None None] Child 85717 exited with status 0
Jul 02 04:40:30 devstack cinder-volume[86038]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 02 04:40:30 devstack cinder-volume[86038]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 04:40:30 devstack cinder-volume[86038]: we strongly recommend against using it for new projects.
Jul 02 04:40:30 devstack cinder-volume[86038]: If you are already using Eventlet, we recommend migrating to a different
Jul 02 04:40:30 devstack cinder-volume[86038]: framework.  For more detail see
Jul 02 04:40:30 devstack cinder-volume[86038]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 04:40:30 devstack cinder-volume[86038]:   import eventlet  # noqa
Jul 02 04:40:33 devstack cinder-volume[86038]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 02 04:40:33 devstack cinder-volume[86038]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 02 04:40:33 devstack cinder-volume[86038]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 02 04:40:33 devstack cinder-volume[86038]: INFO dbcounter [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Registered counter for database cinder
Jul 02 04:40:33 devstack cinder-volume[86038]: DEBUG oslo_db.sqlalchemy.engines [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG dbcounter [-] [86038] Writer thread running {{(pid=86038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:40:34 devstack cinder-volume[86038]: INFO cinder.rpc [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 02 04:40:34 devstack cinder-volume[86038]: INFO cinder.rpc [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_db.sqlalchemy.engines [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:34 devstack cinder-volume[86038]: INFO cinder.volume.manager [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Determined volume DB was empty at startup.
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG cinder.volume.manager [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86038) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 02 04:40:34 devstack cinder-volume[86038]: WARNING stevedore.named [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 02 04:40:34 devstack cinder-volume[86038]: WARNING castellan.key_manager [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:40:34 devstack cinder-volume[86038]: WARNING cinder.keymgr.conf_key_mgr [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 02 04:40:34 devstack cinder-volume[86038]: INFO cinder.volume.manager [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_db.sqlalchemy.engines [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:34 devstack cinder-volume[86038]: INFO oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Starting 1 workers
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Started child 86158 {{(pid=86038) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Full set of CONF: {{(pid=86038) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] ******************************************************************************** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] Configuration options gathered from: {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] ================================================================================ {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] allow_availability_zone_fallback = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] allow_compression_on_image_upload = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] allowed_direct_url_schemes     = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] api_rate_limit                 = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86158]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] auth_strategy                  = keystone {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_availability_zone      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_host                   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_name                   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_stats_polling_interval = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backup_api_class               = cinder.backup.api.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backup_name_template           = backup-%s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backup_use_same_host           = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backup_use_temp_snapshot       = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] chap_password                  = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] chap_username                  =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_internal_tenant_project_id = d9ee67ee407f427fbc035a2e7f2b1f36 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_internal_tenant_user_id = f1dd9a636a2b48a9a991062f6c9b6a25 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cluster                        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] compression_format             = gzip {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] compute_api_class              = cinder.compute.nova.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] config_dir                     = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] config_source                  = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] control_exchange               = openstack {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] debug                          = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] default_availability_zone      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] default_group_type             = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] default_volume_type            = QuobyteHD {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] disk_geometry                  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_client_cert             = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_client_cert_key         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_data_namespace          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_ssl_cert_path           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_ssl_cert_verify         = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] driver_use_ssl                 = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] enable_new_services            = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] enable_unsupported_driver      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] enabled_backends               = ['QuobyteHD'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] enforce_multipath_for_image_xfer = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] filter_function                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_api_insecure            = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_api_ssl_compression     = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_ca_certificates_file    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_catalog_info            = image:glance:publicURL {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_certfile                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_keyfile                 = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_num_retries             = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance_request_timeout         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] goodness_function              = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] graceful_shutdown_timeout      = 5 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] group_api_class                = cinder.group.api.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] host                           = devstack {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_compress_on_upload       = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_conversion_address_space_limit = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_conversion_cpu_limit     = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_conversion_disable       = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_upload_use_cinder_backend = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_upload_use_internal_tenant = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_volume_cache_enabled     = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_volume_cache_max_count   = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] image_volume_cache_max_size_gb = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] init_host_max_objects_retrieval = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] instance_format                = [instance: %(uuid)s]  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iscsi_target_flags             =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iscsi_write_cache              = on {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iser_helper                    = tgtadm {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iser_ip_address                = 192.168.122.169 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iser_port                      = 3260 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_color                      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_config_append              = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_dir                        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_file                       = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_options                    = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_rotate_interval            = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_rotate_interval_type       = days {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] log_rotation_type              = none {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] max_age                        = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] max_logfile_count              = 30 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] max_logfile_size_mb            = 200 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] max_over_subscription_ratio    = 20.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] message_reap_interval          = 86400 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] message_ttl                    = 2592000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] migration_create_volume_timeout_secs = 300 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] monkey_patch                   = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] monkey_patch_modules           = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] my_ip                          = 192.168.122.169 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] no_snapshot_gb_quota           = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] num_iser_scan_tries            = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] num_shell_tries                = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] num_volume_device_scan_tries   = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] nvmeof_conn_info_version       = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] nvmet_ns_id                    = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] nvmet_port_id                  = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_max_limit                = 1000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_ext_list          = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_listen_port       = 8776 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_use_ssl           = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86158) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] osapi_volume_workers           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] per_volume_size_limit          = -1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] periodic_fuzzy_delay           = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] periodic_interval              = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] public_endpoint                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] publish_errors                 = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_backup_gigabytes         = 1000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_backups                  = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_gigabytes                = 1000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_groups                   = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_snapshots                = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] quota_volumes                  = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] rate_limit_burst               = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] rate_limit_except_level        = CRITICAL {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] rate_limit_interval            = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] reinit_driver_count            = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] replication_device             = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] report_discard_supported       = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] report_interval                = 120 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] reservation_clean_interval     = 86400 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] reservation_expire             = 86400 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] reserved_image_namespaces      = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] reserved_percentage            = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] rpc_response_timeout           = 120 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] run_external_periodic_tasks    = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] scst_target_driver             = iscsi {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] scst_target_iqn_name           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_down_time              = 720 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] shell_completion               = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] snapshot_name_template         = snapshot-%s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] split_loggers                  = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] state_path                     = /opt/stack/data/cinder {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] storage_availability_zone      = nova {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] storage_protocol               = iSCSI {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] syslog_log_facility            = LOG_USER {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_helper                  = lioadm {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_ip_address              = 192.168.122.169 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_port                    = 3260 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_protocol                = iscsi {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] target_secondary_ip_addresses  = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] trace_flags                    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] transport_url                  = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] until_refresh                  = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_chap_auth                  = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_default_quota_class        = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_journal                    = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_json                       = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_multipath_for_image_xfer   = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_stderr                     = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] use_syslog                     = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] verify_glance_signatures       = enabled {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_api_class               = cinder.volume.api.API {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_backend_name            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_clear                   = zero {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_clear_ionice            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_clear_size              = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_copy_bps_limit          = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_dd_blocksize            = 1M {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_name_template           = volume-%s {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_service_inithost_offload = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volume_usage_audit_period      = month {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] zoning_mode                    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_concurrency.disable_process_locking = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.auth_section = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.auth_type   = password {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.auth_version = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.cache       = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.certfile    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.include_service_catalog = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.insecure    = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.interface   = public {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.keyfile     = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_password =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcache_username =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.region_name = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.service_type = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.backend                  = dogpile.cache.null {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.backend_argument         = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.backend_expiration_time  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.config_prefix            = cache.oslo {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.debug_cache_backend      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.enable_retry_client      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.enable_socket_keepalive  = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.enabled                  = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.expiration_time          = 600 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.hashclient_retry_attempts = 2 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_dead_retry      = 300 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_pool_maxsize    = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_sasl_enabled    = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.password                 = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.proxies                  = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.redis_db                 = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.redis_server             = localhost:6379 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.retry_attempts           = 2 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.retry_delay              = 0.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.socket_keepalive_count   = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.socket_keepalive_idle    = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.socket_keepalive_interval = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.socket_timeout           = 1.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.tls_allowed_ciphers      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.tls_cafile               = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.tls_certfile             = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.tls_enabled              = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.tls_keyfile              = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cache.username                 = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] coordination.backend_url       = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.asyncio_connection    = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.asyncio_slave_connection = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.backend               = sqlalchemy {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.connection            = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.connection_debug      = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.connection_parameters =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.connection_recycle_time = 3600 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.connection_trace      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.db_inc_retry_interval = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.db_max_retries        = 20 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.db_max_retry_interval = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.db_retry_interval     = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.max_overflow          = 50 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.max_pool_size         = 5 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.max_retries           = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.mysql_wsrep_sync_wait = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.pool_timeout          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.retry_interval        = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.slave_connection      = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.sqlite_synchronous    = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.synchronous_reader    = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] database.use_db_reconnect      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.connection_string     = messaging:// {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.enabled               = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.es_doc_type           = notification {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.es_scroll_size        = 10000 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.es_scroll_time        = 2m {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.filter_error_trace    = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.hmac_keys             = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.sentinel_service_name = mymaster {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.socket_timeout        = 0.1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.trace_requests        = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler.trace_sqlalchemy      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler_jaeger.process_tags   = {} {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler_jaeger.service_name_prefix = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] profiler_otlp.service_name_prefix = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.enforce_new_defaults = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.enforce_scope      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.policy_default_rule = default {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.policy_file        = policy.yaml {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.group          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.helper_command = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86158) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 02 04:40:34 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] privsep_osbrick.user           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.group         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.helper_command = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] cinder_sys_admin.user          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Running cmd (subprocess): mount.quobyte {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.auth_section      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.auth_type         = password {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.cafile            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.certfile          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.collect_timing    = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.insecure          = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.keyfile           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.send_service_user_token = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.split_loggers     = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] service_user.timeout           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.auth_section            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.auth_type               = password {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.certfile                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.collect_timing          = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.insecure                = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.keyfile                 = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.region_name             = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.split_loggers           = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] glance.timeout                 = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.backend_availability_zone = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.chap_password = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.chap_username =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.disk_geometry = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_client_cert = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_client_cert_key = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_data_namespace = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.driver_use_ssl = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.extra_capabilities = {} {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.filter_function = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.goodness_function = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iscsi_target_flags =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iscsi_write_cache = on {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iser_helper   = tgtadm {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iser_port     = 3260 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_host      =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_login     = admin {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_mount_options = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_password  = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_private_key =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_share_path =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.num_shell_tries = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.quobyte_volume_url = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.replication_device = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.report_discard_supported = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.reserved_percentage = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_helper = tgtadm {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_port   = 3260 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_protocol = iscsi {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.trace_flags   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.unique_fqdn_network = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.use_chap_auth = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_backend_name = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_clear  = zero {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_clear_ionice = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_clear_size = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_reports.file_event_handler = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_reports.log_dir           = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.backend_availability_zone = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.backend_host         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.chap_password        = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.chap_username        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.chiscsi_conf         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.disk_geometry        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_client_cert   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_data_namespace = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.driver_use_ssl       = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack quobyte-client[86162]: Reading configuration file: /etc/quobyte/client.cfg
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.extra_capabilities   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.filter_function      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.goodness_function    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack quobyte-client[86162]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iser_helper          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iser_ip_address      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iser_port            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.iser_target_prefix   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_host             = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_login            = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_mount_options    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_password         = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_private_key      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_share_path       = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_ssh_port         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.num_shell_tries      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.nvmet_port_id        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.replication_device   = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.report_discard_supported = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.reserved_percentage  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.scst_target_driver   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.storage_protocol     = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_helper        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_ip_address    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_port          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_prefix        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_protocol      = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.trace_flags          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.use_chap_auth        = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_clear         = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_clear_size    = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] QuobyteHD.volumes_dir          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl      = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_notifications.driver = [] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_notifications.retry = -1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] key_manager.fixed_key          = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.barbican_api_version  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.barbican_endpoint     = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.barbican_endpoint_type = public {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.barbican_region_name  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.cafile                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.certfile              = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.collect_timing        = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.insecure              = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.keyfile               = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.number_of_retries     = 60 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.retry_delay           = 1 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:34 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.send_service_user_token = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.split_loggers         = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.timeout               = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.verify_ssl            = True {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican.verify_ssl_path       = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.auth_section = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.auth_type = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.cafile   = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.certfile = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.collect_timing = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.insecure = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.keyfile  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.split_loggers = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] barbican_service_user.timeout  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.approle_role_id          = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.approle_secret_id        = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.kv_mountpoint            = secret {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.kv_path                  = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.kv_version               = 2 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.namespace                = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.root_token_id            = **** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.ssl_ca_crt_file          = None {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.timeout                  = 60.0 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.use_ssl                  = False {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 02 04:40:34 devstack cinder-volume[86038]: DEBUG oslo_service.backend._eventlet.service [None req-54a92d91-3e0c-4351-af27-e403c64c454b None None] ******************************************************************************** {{(pid=86038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 02 04:40:35 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.607s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:35 devstack cinder-volume[86158]: INFO cinder.volume.driver [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Driver hasn't implemented _init_vendor_properties()
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG cinder.volume.driver [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86158) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_db.sqlalchemy.engines [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86158) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writer thread running {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG cinder.db.api [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Building query based on filter {{(pid=86158) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86158) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:35 devstack cinder-volume[86158]: INFO cinder.keymgr.migration [None req-5d01a684-e8bf-47f6-9e45-a25799da6c71 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 02 04:40:35 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:35 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:36 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.611s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:40:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Driver initialization completed successfully.
Jul 02 04:40:36 devstack cinder-volume[86158]: INFO cinder.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Initiating service 3 cleanup
Jul 02 04:40:36 devstack cinder-volume[86158]: INFO cinder.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Service 3 cleanup completed.
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG cinder.service [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Creating RPC server for service cinder-volume {{(pid=86158) start /opt/stack/cinder/cinder/service.py:231}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG cinder.service [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86158) start /opt/stack/cinder/cinder/service.py:237}}
Jul 02 04:40:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:40:36 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:40:36 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:40:36 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Jul 02 04:40:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.612s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:40:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eed3469b-6dc6-42e3-9532-121115e858af None None] Driver post RPC initialization completed successfully.
Jul 02 04:40:44 devstack cinder-volume[86038]: DEBUG dbcounter [-] [86038] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:40:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=2 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:40:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:40:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:40:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 6 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:40:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:41:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:41:51 devstack sudo[86393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:41:51 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:41:52 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root
Jul 02 04:41:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.678s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:41:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:41:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:41:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 6 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:41:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (63743dd4-e9c8-47ce-b5d3-f743bc17aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bbe766-cb51-4964-98ca-14573b45730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bbe766-cb51-4964-98ca-14573b45730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2110877144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca823f6-076f-4e7c-bdb9-f4b9c309e2f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:19Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661e6bb-9066-47cc-b31a-11d17dc6f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8661e6bb-9066-47cc-b31a-11d17dc6f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c751b-580e-42e9-8647-f3a8eb5017b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c751b-580e-42e9-8647-f3a8eb5017b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca823f6-076f-4e7c-bdb9-f4b9c309e2f5', 'volume_name': 'volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0229f932-fdd9-42c3-9ba8-0155628c6b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0229f932-fdd9-42c3-9ba8-0155628c6b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bbaaa9-6295-4d6b-ad74-f438d3cb3901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Volume eca823f6-076f-4e7c-bdb9-f4b9c309e2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5', 'volume_size': 1}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2110877144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca823f6-076f-4e7c-bdb9-f4b9c309e2f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:19Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Creating volume eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:42:19 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:19 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 1073741824
Jul 02 04:42:19 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Flow 'volume_create_manager' (02e2848d-1c78-43d5-b972-9424af17afef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a14ebeb-353c-4cf2-922b-b05eb0c63a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a14ebeb-353c-4cf2-922b-b05eb0c63a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1107362590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47baa1-811a-4426-b979-e57590e3e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8589ebaae4e7486d84407d608e182e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:20Z,use_quota=True,user_id='b032072770fc4a0b8790f0fc60c1a062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5b72cb-e8b8-43b2-b727-266c72c90606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5b72cb-e8b8-43b2-b727-266c72c90606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b0a4e5-3831-4691-9984-a153d0300cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b0a4e5-3831-4691-9984-a153d0300cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c47baa1-811a-4426-b979-e57590e3e6d4', 'volume_name': 'volume-7c47baa1-811a-4426-b979-e57590e3e6d4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59962356-d691-4f4e-a224-b51d5ff18c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59962356-d691-4f4e-a224-b51d5ff18c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58c9eea-33c7-4fa0-9cc4-13bd9c8d0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:19 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Volume 7c47baa1-811a-4426-b979-e57590e3e6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c47baa1-811a-4426-b979-e57590e3e6d4', 'volume_size': 1}
Jul 02 04:42:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:20 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 1073741824" returned: 0 in 1.113s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:20 devstack sudo[87031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5
Jul 02 04:42:20 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:21 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" returned: 0 in 0.700s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1107362590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c47baa1-811a-4426-b979-e57590e3e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8589ebaae4e7486d84407d608e182e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:20Z,use_quota=True,user_id='b032072770fc4a0b8790f0fc60c1a062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Creating volume 7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:42:21 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bbaaa9-6295-4d6b-ad74-f438d3cb3901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:21 devstack sudo[87034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 1073741824
Jul 02 04:42:21 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614e5cc7-32a6-4780-9b0e-bf8d04ed6c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Volume volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 (eca823f6-076f-4e7c-bdb9-f4b9c309e2f5): created successfully
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614e5cc7-32a6-4780-9b0e-bf8d04ed6c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (63743dd4-e9c8-47ce-b5d3-f743bc17aa05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-411ff84f-198c-414f-bf1c-8cf135ed2815 tempest-VolumesTestJSON-696405089 None] Created volume successfully.
Jul 02 04:42:22 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 1073741824" returned: 0 in 1.257s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:22 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4
Jul 02 04:42:22 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (6f12a7ea-356d-4dba-84f0-ccb1c348f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b10ab7-c31b-4359-a4f6-dba5a5281c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b10ab7-c31b-4359-a4f6-dba5a5281c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1353393147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fbfb14-b978-4ec8-80f0-bc71785f1064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:23Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d403c131-6d7e-4c52-96e1-9cdc560f8680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d403c131-6d7e-4c52-96e1-9cdc560f8680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd83514-1cd9-48be-ab9a-24cfb398ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd83514-1cd9-48be-ab9a-24cfb398ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fbfb14-b978-4ec8-80f0-bc71785f1064', 'volume_name': 'volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed497df1-fa4f-4879-b2ae-5685fff20882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed497df1-fa4f-4879-b2ae-5685fff20882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cca6a49-0f2f-4474-bee2-7fa614288072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Volume b9fbfb14-b978-4ec8-80f0-bc71785f1064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064', 'volume_size': 1}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:23 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4" returned: 0 in 0.897s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1353393147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fbfb14-b978-4ec8-80f0-bc71785f1064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:23Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Creating volume b9fbfb14-b978-4ec8-80f0-bc71785f1064 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:42:23 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58c9eea-33c7-4fa0-9cc4-13bd9c8d0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c47baa1-811a-4426-b979-e57590e3e6d4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 1073741824
Jul 02 04:42:23 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21421b66-22a6-4875-88f9-be3baca928ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Volume volume-7c47baa1-811a-4426-b979-e57590e3e6d4 (7c47baa1-811a-4426-b979-e57590e3e6d4): created successfully
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21421b66-22a6-4875-88f9-be3baca928ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Flow 'volume_create_manager' (02e2848d-1c78-43d5-b972-9424af17afef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-59fdea0f-e500-49f5-a248-d23bb3f9861e req-f62b6357-5255-4423-8be4-3ac6e0a506c5 tempest-VolumesSnapshotsTestJSON-643478539 None] Created volume successfully.
Jul 02 04:42:24 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 1073741824" returned: 0 in 1.068s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:24 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064
Jul 02 04:42:24 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:25 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064" returned: 0 in 0.763s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.631s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cca6a49-0f2f-4474-bee2-7fa614288072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92821c51-4021-44d0-a5b8-d6d19224c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:25 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Volume volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 (b9fbfb14-b978-4ec8-80f0-bc71785f1064): created successfully
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92821c51-4021-44d0-a5b8-d6d19224c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (6f12a7ea-356d-4dba-84f0-ccb1c348f94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Creating offline snapshot feeeed30-ce4a-4827-b51d-dab761a45598 of volume 7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:42:25 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2bso0bg_/privsep.sock']
Jul 02 04:42:25 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a97c02b5-3aa9-4cc8-8e00-544a563f8d40 tempest-VolumesTestJSON-696405089 None] Created volume successfully.
Jul 02 04:42:25 devstack sudo[87053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2bso0bg_/privsep.sock
Jul 02 04:42:25 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 04:42:26 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 02 04:42:27 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 02 04:42:27 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 02 04:42:27 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 02 04:42:27 devstack cinder-volume[86158]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (22de4661-7fcb-4867-ba16-51e3a2cb672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf01247-cdd0-45bc-9e9d-79dacee9c92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf01247-cdd0-45bc-9e9d-79dacee9c92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037896359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78e3c4-ea48-4b12-951a-c661a201730f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:27Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f516d4-bc57-4aea-b8f0-2818271bf750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f516d4-bc57-4aea-b8f0-2818271bf750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311c749f-0857-4b00-afcc-a0a2ce43a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311c749f-0857-4b00-afcc-a0a2ce43a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab78e3c4-ea48-4b12-951a-c661a201730f', 'volume_name': 'volume-ab78e3c4-ea48-4b12-951a-c661a201730f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac29cf-f839-4f11-8dc2-e14a7cf5c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac29cf-f839-4f11-8dc2-e14a7cf5c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107ba62-851c-4c6e-9e41-66ddd07b45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Volume ab78e3c4-ea48-4b12-951a-c661a201730f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab78e3c4-ea48-4b12-951a-c661a201730f', 'volume_size': 1}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:27 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Spawned new privsep daemon via rootwrap
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Accepted privsep connection to /tmp/tmp2bso0bg_/privsep.sock {{(pid=86158) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 02 04:42:27 devstack cinder-volume[86158]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87057
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ab5c4b-0e46-486e-b5f0-f581d1333570]: (2,) {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ae9ac-b4fa-4188-9566-9917a1213d5c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:27 devstack sudo[87059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4
Jul 02 04:42:27 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:28 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4" returned: 0 in 0.825s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:28 devstack sudo[87065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 1G
Jul 02 04:42:28 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:29 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 1G" returned: 0 in 0.926s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c47baa1-811a-4426-b979-e57590e3e6d4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:29 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c47baa1-811a-4426-b979-e57590e3e6d4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598
Jul 02 04:42:29 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:30 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c47baa1-811a-4426-b979-e57590e3e6d4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598" returned: 0 in 0.952s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:30 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 is being set with open permissions: ugo+rw
Jul 02 04:42:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:30 devstack sudo[87078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598
Jul 02 04:42:30 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:30 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598" returned: 0 in 0.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:30 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info
Jul 02 04:42:30 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:31 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info" returned: 0 in 0.794s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:31 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info is being set with open permissions: ugo+rw
Jul 02 04:42:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:31 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info
Jul 02 04:42:31 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:32 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.info" returned: 0 in 0.711s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.984s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037896359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78e3c4-ea48-4b12-951a-c661a201730f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980210b8adf04fa2b3fde6ebcee407b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:27Z,use_quota=True,user_id='42f2af487b724abc9de8052f991ed1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Creating volume ab78e3c4-ea48-4b12-951a-c661a201730f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:42:32 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:32 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f 1073741824
Jul 02 04:42:32 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-66556dd7-47c8-4b9e-8e88-f644a757da55 req-2b4c4493-259c-4deb-995b-08b96ead1103 tempest-VolumesSnapshotsTestJSON-643478539 None] Create snapshot completed successfully
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "cinder-feeeed30-ce4a-4827-b51d-dab761a45598-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-feeeed30-ce4a-4827-b51d-dab761a45598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "cinder-quobyte-feeeed30-ce4a-4827-b51d-dab761a45598" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-feeeed30-ce4a-4827-b51d-dab761a45598" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Deleting offline snapshot feeeed30-ce4a-4827-b51d-dab761a45598 of volume 7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] snapshot_file for this snap is: volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cfcb14-dd37-4e8f-8ca9-1ba55d488a8b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:33 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598
Jul 02 04:42:33 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:33 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f 1073741824" returned: 0 in 0.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:33 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f
Jul 02 04:42:33 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:34 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598" returned: 0 in 0.996s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c47baa1-811a-4426-b979-e57590e3e6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8364dcd0-4f6a-4daf-b493-40febd044819]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:34 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4
Jul 02 04:42:34 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:34 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f" returned: 0 in 0.773s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107ba62-851c-4c6e-9e41-66ddd07b45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab78e3c4-ea48-4b12-951a-c661a201730f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491580ab-b321-4fae-b85e-4d7a3e4fe73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Volume volume-ab78e3c4-ea48-4b12-951a-c661a201730f (ab78e3c4-ea48-4b12-951a-c661a201730f): created successfully
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491580ab-b321-4fae-b85e-4d7a3e4fe73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Flow 'volume_create_manager' (22de4661-7fcb-4867-ba16-51e3a2cb672d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6f3c3213-a989-47d7-91d1-79fbb2b24b72 tempest-VolumesTestJSON-696405089 None] Created volume successfully.
Jul 02 04:42:34 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4" returned: 0 in 0.884s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:35 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598
Jul 02 04:42:35 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:36 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598" returned: 0 in 1.083s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:36 devstack sudo[87177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598
Jul 02 04:42:36 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-ab78e3c4-ea48-4b12-951a-c661a201730f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "cinder-ab78e3c4-ea48-4b12-951a-c661a201730f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-quobyte-ab78e3c4-ea48-4b12-951a-c661a201730f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-ab78e3c4-ea48-4b12-951a-c661a201730f" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f42902-c204-4e5d-84e3-9e2f3165976c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:36 devstack sudo[87179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f
Jul 02 04:42:36 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:37 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4.feeeed30-ce4a-4827-b51d-dab761a45598" returned: 0 in 0.964s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-feeeed30-ce4a-4827-b51d-dab761a45598" released by "_delete_snapshot" :: held 4.065s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" released by "delete_snapshot" :: held 4.102s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:37 devstack cinder-volume[86158]: WARNING cinder.quota [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:42:37 devstack cinder-volume[86158]: WARNING cinder.quota [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.quota [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Created reservations ['7e7e8106-08f8-44a5-98e2-5ee8814952af', 'ef7f759f-5144-4c15-8829-cda572e5a554', '4cb5778c-26aa-4e8e-8f51-f7c1dbb20659', 'b69b3ffe-1b50-4709-800c-13a98bdbd76c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:42:37 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f" returned: 0 in 0.918s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:37 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f
Jul 02 04:42:37 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Delete snapshot completed successfully.
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-9b71878b-7fff-48e3-8b1e-4fd89de60ddf req-3d5637b5-4dec-4ca4-aabd-bb98324dee29 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-feeeed30-ce4a-4827-b51d-dab761a45598-delete_snapshot" released by "delete_snapshot" :: held 4.425s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "cinder-7c47baa1-811a-4426-b979-e57590e3e6d4-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-7c47baa1-811a-4426-b979-e57590e3e6d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc7711e-3bf2-46d3-9b72-fd9926d3af56]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:37 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4
Jul 02 04:42:37 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:37 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ab78e3c4-ea48-4b12-951a-c661a201730f" returned: 0 in 0.718s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-ab78e3c4-ea48-4b12-951a-c661a201730f" released by "delete_volume" :: held 1.690s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:38 devstack cinder-volume[86158]: WARNING cinder.quota [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Created reservations ['a531dd65-1b60-4571-afdb-96b5603afd1a', '7eafd464-c08e-44b2-833c-572cbd90b3cf', 'dc1f8be3-a2e0-4a60-836f-d26a59d8653c', '95e89c0a-7c3f-4a2f-9899-bdfe660ca7a7'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:38 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:42:38 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-b9fbfb14-b978-4ec8-80f0-bc71785f1064-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "cinder-b9fbfb14-b978-4ec8-80f0-bc71785f1064-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-quobyte-b9fbfb14-b978-4ec8-80f0-bc71785f1064" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-b9fbfb14-b978-4ec8-80f0-bc71785f1064" acquired by "delete_volume" :: waited 0.059s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7276110b-aac0-4454-9e39-61a8c37fefa4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:38 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4" returned: 0 in 1.092s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:38 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4
Jul 02 04:42:38 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:39 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064
Jul 02 04:42:39 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:39 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.094s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:42:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Deleted volume successfully.
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4f3d3c23-d37d-4cf4-b67d-7cd0e8c1b542 tempest-VolumesTestJSON-696405089 None] Lock "cinder-ab78e3c4-ea48-4b12-951a-c661a201730f-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:39 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7c47baa1-811a-4426-b979-e57590e3e6d4" returned: 0 in 0.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:39 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064" returned: 0 in 1.031s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-quobyte-7c47baa1-811a-4426-b979-e57590e3e6d4" released by "delete_volume" :: held 2.146s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:39 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064
Jul 02 04:42:39 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:39 devstack cinder-volume[86158]: DEBUG cinder.quota [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Created reservations ['cfef736c-745f-4ce4-9984-fd0ccaac90dc', '2efd1992-e051-4fb1-8bf9-da08de88e238', '3fc88acc-d503-45a9-8c31-5b45450dadb1', '58f66ee5-78fe-4631-90af-7c53d95544c3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:40 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:42:40 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:41 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.973s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.manager [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:42:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Deleted volume successfully.
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-52ea873f-e9a3-44ac-af94-6c2f4b846f3f req-405e7b3d-7cb6-4cc6-a638-d7bcc54b0021 tempest-VolumesSnapshotsTestJSON-643478539 None] Lock "cinder-7c47baa1-811a-4426-b979-e57590e3e6d4-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:41 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b9fbfb14-b978-4ec8-80f0-bc71785f1064" returned: 0 in 1.313s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-b9fbfb14-b978-4ec8-80f0-bc71785f1064" released by "delete_volume" :: held 2.400s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Created reservations ['74de949a-374b-44bc-bd11-8c6597cc8cd4', '92bfbfb4-33a1-46de-b1c1-19b4241c7d11', '7c1b24a8-0a81-4cdd-a269-dbe71dde1be4', 'c8d87ec3-e0c2-4e8a-9554-bfe8c88ab726'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:41 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:42:41 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "cinder-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Acquiring lock "cinder-quobyte-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e88c2-bfe3-4d00-bf3b-820a4bf942d8]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:42 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.181s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:42:42 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Deleted volume successfully.
Jul 02 04:42:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f54998b-112a-4d9d-b4ae-bb86c960f12c tempest-VolumesTestJSON-696405089 None] Lock "cinder-b9fbfb14-b978-4ec8-80f0-bc71785f1064-delete_volume" released by "delete_volume" :: held 3.972s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:42 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5
Jul 02 04:42:42 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:43 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" returned: 0 in 1.025s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:43 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5
Jul 02 04:42:43 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:44 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" returned: 0 in 0.953s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "cinder-quobyte-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5" released by "delete_volume" :: held 2.046s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Created reservations ['2ea59cd9-4be8-4966-913a-57ed218dc627', '757f1878-8741-4c37-a1c5-c9e36f171fac', 'f465b3da-9262-42ef-b53c-6ed0352c86c8', 'f9f85191-5f24-44ac-843d-4a552679761e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:44 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:42:44 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:45 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.160s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:45 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:42:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Deleted volume successfully.
Jul 02 04:42:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da5a0418-30d9-42d7-88fd-a1baa2bd1ce5 tempest-VolumesTestJSON-696405089 None] Lock "cinder-eca823f6-076f-4e7c-bdb9-f4b9c309e2f5-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:42:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-36e5fd94-80d2-470e-95aa-69d5886af014 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-496896396: creating
Jul 02 04:42:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-36e5fd94-80d2-470e-95aa-69d5886af014 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-496896396: created successfully
Jul 02 04:42:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-36e5fd94-80d2-470e-95aa-69d5886af014 tempest-GroupSnapshotsTest-1279672838 None] Create group completed successfully.
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:51 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:42:51 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:52 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.994s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (24d28c26-32d1-49e3-81bc-ece8a695bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f919180-2713-40b6-b410-3ca2cf24f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f919180-2713-40b6-b410-3ca2cf24f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407043531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80304924-50da-44a8-b193-533e5e4cd069,host='devstack@QuobyteHD#QuobyteHD',id=cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:53Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(155c2b5a-cf13-4b8f-9fe8-0c9e80ec1b31),volume_type_id=155c2b5a-cf13-4b8f-9fe8-0c9e80ec1b31)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1602b3c4-06a2-4f88-95ed-25a3a40c9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1602b3c4-06a2-4f88-95ed-25a3a40c9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3449623-c3f8-4b41-b91e-64a29ed04a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3449623-c3f8-4b41-b91e-64a29ed04a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7', 'volume_name': 'volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8965a3a5-6916-4734-978c-ea96481efd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8965a3a5-6916-4734-978c-ea96481efd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a72980-f664-4d1f-bfe5-42bf7905cdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Volume cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7', 'volume_size': 1}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=80304924-50da-44a8-b193-533e5e4cd069,created_at=2026-07-02T02:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407043531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=80304924-50da-44a8-b193-533e5e4cd069,host='devstack@QuobyteHD#QuobyteHD',id=cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:42:53Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(155c2b5a-cf13-4b8f-9fe8-0c9e80ec1b31),volume_type_id=155c2b5a-cf13-4b8f-9fe8-0c9e80ec1b31)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Creating volume cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:42:53 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:42:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:53 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 1073741824
Jul 02 04:42:53 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:54 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 1073741824" returned: 0 in 1.061s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:54 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:42:54 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ce3c5b02-478f-4cb1-96ba-b7950679a01f tempest-BackendsCapabilitiesAdminTestsJSON-390127234 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86158) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 02 04:42:55 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a72980-f664-4d1f-bfe5-42bf7905cdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecefca9d-1a44-490c-a27d-796a937f757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:42:55 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Volume volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 (cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7): created successfully
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecefca9d-1a44-490c-a27d-796a937f757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (24d28c26-32d1-49e3-81bc-ece8a695bc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:42:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-94dbf26d-13e2-4b48-834a-388371359c13 tempest-GroupSnapshotsTest-1279672838 None] Created volume successfully.
Jul 02 04:42:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2dbd0496-ec32-42c7-bd24-ae6d730adb14 tempest-BackendsCapabilitiesAdminTestsJSON-390127234 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86158) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 02 04:42:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] GroupSnapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: creating.
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Group snapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: creating. {{(pid=86158) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Creating offline snapshot d451b690-5218-45f3-8235-b0b73a3c0835 of volume cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52da7c1-c5da-4a32-aecc-3e4605084426]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:42:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:56 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:42:56 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:57 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 1.268s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:57 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 1G
Jul 02 04:42:57 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:42:59 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Jul 02 04:42:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 1G" returned: 0 in 1.317s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:42:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:42:59 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:42:59 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:00 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 1.359s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:00 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:00 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:43:00 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:01 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 1.046s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:01 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info
Jul 02 04:43:01 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:03 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info" returned: 0 in 1.595s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:03 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:03 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info
Jul 02 04:43:03 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Flow 'volume_create_manager' (0a07af41-11e3-44b1-8051-22da2b517d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fccf3e8-a84f-4c99-b4da-87edaf3c559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fccf3e8-a84f-4c99-b4da-87edaf3c559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1919484657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b626a36-afb7-4d9f-8198-e5511d6df0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd46d170534434996a3b093076fba61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:03Z,use_quota=True,user_id='2120d29bde3d4be6938e3b8ed21047f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5dfd72-ec8a-4354-9c3d-c84cf78a4fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5dfd72-ec8a-4354-9c3d-c84cf78a4fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3070703c-2fd5-43ef-b05d-9e9635ea7641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3070703c-2fd5-43ef-b05d-9e9635ea7641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b626a36-afb7-4d9f-8198-e5511d6df0e2', 'volume_name': 'volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2568359f-2f5f-4ca5-862c-0ef2c75734c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2568359f-2f5f-4ca5-862c-0ef2c75734c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b442d2-cfb1-47a2-83ec-de756ea1b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:03 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Volume 3b626a36-afb7-4d9f-8198-e5511d6df0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2', 'volume_size': 1}
Jul 02 04:43:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:04 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.info" returned: 0 in 1.729s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.451s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1919484657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b626a36-afb7-4d9f-8198-e5511d6df0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd46d170534434996a3b093076fba61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:03Z,use_quota=True,user_id='2120d29bde3d4be6938e3b8ed21047f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Creating volume 3b626a36-afb7-4d9f-8198-e5511d6df0e2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:43:04 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:43:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:05 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 1073741824
Jul 02 04:43:05 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:05 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d73f5f18-f4a8-4134-8f9b-048ebd3c4510 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: created successfully
Jul 02 04:43:06 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 1073741824" returned: 0 in 1.898s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:07 devstack sudo[87468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2
Jul 02 04:43:07 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:08 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2" returned: 0 in 1.277s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] <== create_volume: return (3270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.278s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.048s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835-1fad45a3-0405-490c-a987-ed34ba1c65a0" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b442d2-cfb1-47a2-83ec-de756ea1b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d7f4b4-1453-4b04-b337-b070f5f98d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835-1fad45a3-0405-490c-a987-ed34ba1c65a0" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Creating volume 1fad45a3-0405-490c-a987-ed34ba1c65a0 from snapshot d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Volume volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 (3b626a36-afb7-4d9f-8198-e5511d6df0e2): created successfully
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d7f4b4-1453-4b04-b337-b070f5f98d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Flow 'volume_create_manager' (0a07af41-11e3-44b1-8051-22da2b517d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] snapshot: d451b690-5218-45f3-8235-b0b73a3c0835, volume: 1fad45a3-0405-490c-a987-ed34ba1c65a0,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Flow 'volume_create_manager' (3c324cf7-86e2-4d5d-af5d-d4d9ef45a908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06468377-5f18-45fc-af6d-1bddf5c3b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-417e05ba-e572-4f1f-8dd6-a42e7d55c365 tempest-DeleteServersTestJSON-1092277772 None] Created volume successfully.
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06468377-5f18-45fc-af6d-1bddf5c3b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-126453777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3fc634-d98d-4fc8-aba4-babc93e8600c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f430699cc9ba4e7bb82c39ebd144f9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:08Z,use_quota=True,user_id='fd274438aa00411daba037c24b281b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2207a450-369b-49cd-904b-48addc67ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2207a450-369b-49cd-904b-48addc67ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8eb97c-a115-4e5c-8d69-e0dbf56cb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8eb97c-a115-4e5c-8d69-e0dbf56cb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3fc634-d98d-4fc8-aba4-babc93e8600c', 'volume_name': 'volume-de3fc634-d98d-4fc8-aba4-babc93e8600c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26c38a6-fb39-4117-9f4e-2a1f42f527b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26c38a6-fb39-4117-9f4e-2a1f42f527b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e5ab0-5372-41a2-a1d6-e0d0ee5f1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Volume de3fc634-d98d-4fc8-aba4-babc93e8600c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3fc634-d98d-4fc8-aba4-babc93e8600c', 'volume_size': 1}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[972373eb-1364-40c6-9679-7a21c9078e82]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:08 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:43:08 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:09 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 1.105s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a662f-bbea-4d08-b7f3-bd1eeee2b46d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:09 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:43:09 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:10 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 1.095s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:10 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:43:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:10 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0
Jul 02 04:43:10 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:17 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0" returned: 0 in 6.714s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633eb7e-48a7-4001-a286-02bc109a3168]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:17 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:43:17 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:18 devstack cinder-volume[86158]: WARNING py.warnings [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 02 04:43:18 devstack cinder-volume[86158]:   .first()
Jul 02 04:43:18 devstack cinder-volume[86158]: 
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=54,cinder:UPDATE=62,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=60,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:18 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 1.077s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:43:18 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Converted 1024.00 MB image at 152.48 MB/s
Jul 02 04:43:18 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:18 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0
Jul 02 04:43:18 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:19 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0" returned: 0 in 0.671s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" released by "_copy_volume_from_snapshot" :: held 10.923s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835-1fad45a3-0405-490c-a987-ed34ba1c65a0" released by "_create_volume_from_snapshot" :: held 10.980s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.023s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.784s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-126453777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3fc634-d98d-4fc8-aba4-babc93e8600c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f430699cc9ba4e7bb82c39ebd144f9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:08Z,use_quota=True,user_id='fd274438aa00411daba037c24b281b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Creating volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:43:19 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:43:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:19 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c 1073741824
Jul 02 04:43:19 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-fcefee68-f7db-4a85-8e65-e8ebb5b0fbbc tempest-GroupSnapshotsTest-1279672838 None] Create group from source-snapshot-00ddff40-ce4d-418c-b398-ae717ab1d207 completed successfully.
Jul 02 04:43:20 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c 1073741824" returned: 0 in 1.067s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:20 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c
Jul 02 04:43:20 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f272e5f-f441-423e-b29c-2e44e83948ce]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:20 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0
Jul 02 04:43:20 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:21 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c" returned: 0 in 0.733s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.757s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e5ab0-5372-41a2-a1d6-e0d0ee5f1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3fc634-d98d-4fc8-aba4-babc93e8600c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d73b322-a7b4-451c-950b-13d8f63493c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae907036-f5ea-4ffa-9efb-76924783cad0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Volume volume-de3fc634-d98d-4fc8-aba4-babc93e8600c (de3fc634-d98d-4fc8-aba4-babc93e8600c): created successfully
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d73b322-a7b4-451c-950b-13d8f63493c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Flow 'volume_create_manager' (3c324cf7-86e2-4d5d-af5d-d4d9ef45a908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-31677731-bfe2-42fb-9957-f91f04988d7f tempest-SnapshotsActionsTest-2127542035 None] Created volume successfully.
Jul 02 04:43:21 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2
Jul 02 04:43:21 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:21 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0" returned: 0 in 1.070s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:21 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0
Jul 02 04:43:21 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:22 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2" returned: 0 in 1.018s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fe71419-993f-4f4a-ab54-85ccd1e18cbf', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Creating offline snapshot 84507656-a6a6-489f-a5ea-b0acd69af96f of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d5ef5-0e14-469b-a1cd-7eeca7a1d880]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-eab97f2b-7833-4f27-9ae3-ffe3bcbbb0ae req-7ea7844b-1a4a-4849-9d3b-9c930ef7fc81 tempest-DeleteServersTestJSON-1092277772 None] attachment_update completed successfully.
Jul 02 04:43:22 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1fad45a3-0405-490c-a987-ed34ba1c65a0" returned: 0 in 0.947s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-1fad45a3-0405-490c-a987-ed34ba1c65a0" released by "delete_volume" :: held 2.096s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:22 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c
Jul 02 04:43:22 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['b6ef4ad2-8075-4a51-8f24-b1b52dd4ed50'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:22 devstack cinder-volume[86158]: WARNING cinder.quota [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-161862068 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-161862068, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:43:22 devstack cinder-volume[86158]: WARNING cinder.quota [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-161862068 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-161862068, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['2daab795-fe9c-47ed-b4d5-c77ef0843c81', '553bccac-5707-4b16-96dd-5efa03dc0fc0', '736c7422-0373-4335-9da0-f525cf52722e', '8ec76c91-c2ae-4c58-95cc-f911d99d5cee'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:22 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:43:22 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: deleting
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: deleting {{(pid=86158) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Deleting offline snapshot d451b690-5218-45f3-8235-b0b73a3c0835 of volume cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] snapshot_file for this snap is: volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[873aa3a7-738d-4e75-9a1d-409c923b64b6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:23 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:43:23 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:24 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.199s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:43:24 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d780bd91-5538-4654-aa64-a7ef75eb94f3 tempest-GroupSnapshotsTest-1279672838 None] Delete group completed successfully.
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c" returned: 0 in 1.633s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:24 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f 1G
Jul 02 04:43:24 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:24 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 1.269s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13d423-a98a-4e03-9d0e-7a08a6531faa]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:24 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:43:24 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:25 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f 1G" returned: 0 in 1.003s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:25 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:25 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:25 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 0.852s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:25 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:43:25 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:25 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.740s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:25 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f is being set with open permissions: ugo+rw
Jul 02 04:43:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:25 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:25 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:26 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 0.822s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:26 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835
Jul 02 04:43:26 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:26 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.658s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:26 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info
Jul 02 04:43:26 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:27 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7.d451b690-5218-45f3-8235-b0b73a3c0835" returned: 0 in 0.693s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-d451b690-5218-45f3-8235-b0b73a3c0835" released by "_delete_snapshot" :: held 3.846s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" released by "delete_snapshot" :: held 3.886s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:27 devstack cinder-volume[86158]: WARNING cinder.quota [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-161862068 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-161862068, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['0b685abe-bc93-4706-9bd9-df072f8b5420', '02cd4684-4936-484e-aaa3-5b1878db33ff', 'dbf741b3-adeb-4aa8-9a3c-ec49970cd974', '815b1ea2-d6d4-41d2-986d-92c892e0969f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:27 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info" returned: 0 in 0.778s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:27 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info is being set with open permissions: ugo+rw
Jul 02 04:43:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:27 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info
Jul 02 04:43:27 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e7898c79-b599-4976-ad82-f829ee24c7b9 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 00ddff40-ce4d-418c-b398-ae717ab1d207: deleted successfully
Jul 02 04:43:28 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.info" returned: 0 in 0.765s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.757s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6b429ed4-5419-4f0a-95e9-d44985ba2659 tempest-SnapshotsActionsTest-2127542035 None] Create snapshot completed successfully
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb5e7e-0b8c-4da8-9b84-64d500c261c2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:28 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:43:28 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:29 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 0.903s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:29 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7
Jul 02 04:43:29 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Creating offline snapshot 9f304695-d278-45ae-aa02-eab1a97d24d6 of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf195ff-f606-479c-a59e-b3a3cf8001d2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:29 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:29 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:30 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" returned: 0 in 1.258s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-cd93b8a8-b845-4dd0-b92b-2b2d14a01aa7" released by "delete_volume" :: held 2.258s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['7fbb33d8-bc35-41fb-a8c5-52d8e892c205'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:30 devstack cinder-volume[86158]: WARNING cinder.db.api [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-161862068']
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['501ce73c-9913-4081-a10d-b50cfc909866', 'edcde00e-a00f-4ac2-9b72-951b1eb8b33f', '70c965b7-650b-451b-95a9-7ed616820e20', '99f39bd1-5d9f-4b6d-8ba1-2df2757262d3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:30 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 1.390s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:31 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 1G
Jul 02 04:43:31 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:31 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:43:31 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f711911f-0fa3-4663-b79a-a8836f6b4255 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-340171590: creating
Jul 02 04:43:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f711911f-0fa3-4663-b79a-a8836f6b4255 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-340171590: created successfully
Jul 02 04:43:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f711911f-0fa3-4663-b79a-a8836f6b4255 tempest-GroupSnapshotsTest-1279672838 None] Create group completed successfully.
Jul 02 04:43:32 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.230s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:43:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d00b750e-54f5-40a0-8b15-0d525262dd7f tempest-GroupSnapshotsTest-1279672838 None] Delete group completed successfully.
Jul 02 04:43:32 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 1G" returned: 0 in 1.347s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:32 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6
Jul 02 04:43:32 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:33 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6" returned: 0 in 1.018s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:33 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 is being set with open permissions: ugo+rw
Jul 02 04:43:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:33 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6
Jul 02 04:43:33 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:33 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:43:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (ef737456-dfd8-445c-bd71-3420a2b62f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9900e205-dd5d-4357-a027-5acfe778256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9900e205-dd5d-4357-a027-5acfe778256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1347738750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,host='devstack@QuobyteHD#QuobyteHD',id=88941219-a6e8-4a97-bb59-b75d26aef43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:34Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901759f6-4b89-4d1e-a443-a13ab5d004e7),volume_type_id=901759f6-4b89-4d1e-a443-a13ab5d004e7)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e48e1-a532-457e-b0a6-5a85eb213c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e48e1-a532-457e-b0a6-5a85eb213c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d54a16-f4c2-40df-971e-3e0c760a1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d54a16-f4c2-40df-971e-3e0c760a1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88941219-a6e8-4a97-bb59-b75d26aef43f', 'volume_name': 'volume-88941219-a6e8-4a97-bb59-b75d26aef43f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c244e2-936a-4464-bd64-62bcf36eb009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c244e2-936a-4464-bd64-62bcf36eb009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11009a2-edb4-47ee-9cc0-8afd53742eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Volume 88941219-a6e8-4a97-bb59-b75d26aef43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88941219-a6e8-4a97-bb59-b75d26aef43f', 'volume_size': 1}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-0db7a777-000a-49d7-823b-220142bb63e5 req-6a6dc10a-a59c-4956-86ab-5f4470c9094a tempest-DeleteServersTestJSON-1092277772 None] Terminate volume connection completed successfully.
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-0db7a777-000a-49d7-823b-220142bb63e5 req-6a6dc10a-a59c-4956-86ab-5f4470c9094a tempest-DeleteServersTestJSON-1092277772 None] Deleting attachment 3fe71419-993f-4f4a-ab54-85ccd1e18cbf. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:43:34 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6" returned: 0 in 0.955s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.815s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,created_at=2026-07-02T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1347738750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,host='devstack@QuobyteHD#QuobyteHD',id=88941219-a6e8-4a97-bb59-b75d26aef43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:34Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901759f6-4b89-4d1e-a443-a13ab5d004e7),volume_type_id=901759f6-4b89-4d1e-a443-a13ab5d004e7)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Creating volume 88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:43:34 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:34 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f 1073741824
Jul 02 04:43:34 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ed64cd12-24f0-4a44-b880-146fa77712ba tempest-SnapshotsActionsTest-2127542035 None] Create snapshot completed successfully
Jul 02 04:43:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-9f304695-d278-45ae-aa02-eab1a97d24d6-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-9f304695-d278-45ae-aa02-eab1a97d24d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-9f304695-d278-45ae-aa02-eab1a97d24d6" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-9f304695-d278-45ae-aa02-eab1a97d24d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Deleting offline snapshot 9f304695-d278-45ae-aa02-eab1a97d24d6 of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] snapshot_file for this snap is: volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e39a27-5cf1-4f77-9f64-cf0f5f4f3326]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:35 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6
Jul 02 04:43:35 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:35 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f 1073741824" returned: 0 in 1.046s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:35 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f
Jul 02 04:43:35 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:36 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6" returned: 0 in 0.913s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec0e35-49d7-44b5-b431-75b50e983b23]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:36 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f" returned: 0 in 0.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:36 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:36 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11009a2-edb4-47ee-9cc0-8afd53742eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88941219-a6e8-4a97-bb59-b75d26aef43f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba6b2f6-c034-45b3-989f-4e1a932c598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Volume volume-88941219-a6e8-4a97-bb59-b75d26aef43f (88941219-a6e8-4a97-bb59-b75d26aef43f): created successfully
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba6b2f6-c034-45b3-989f-4e1a932c598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (ef737456-dfd8-445c-bd71-3420a2b62f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8fdb25df-da0e-454e-8ce6-87c6f9676e6c tempest-GroupSnapshotsTest-1279672838 None] Created volume successfully.
Jul 02 04:43:36 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.904s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:37 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6
Jul 02 04:43:37 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (4646a0ee-0bc4-4c6e-99b9-cceaf06de92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33849b3-0258-469f-9446-421bd21200ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33849b3-0258-469f-9446-421bd21200ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878671115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,host='devstack@QuobyteHD#QuobyteHD',id=fc534586-c9ee-473a-9b38-bf6b11ee89a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:37Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901759f6-4b89-4d1e-a443-a13ab5d004e7),volume_type_id=901759f6-4b89-4d1e-a443-a13ab5d004e7)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272b5249-1d7d-4cd7-b188-8f14ee69c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272b5249-1d7d-4cd7-b188-8f14ee69c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75326d1a-c8cc-4538-a347-789bd1612c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75326d1a-c8cc-4538-a347-789bd1612c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc534586-c9ee-473a-9b38-bf6b11ee89a4', 'volume_name': 'volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406ff931-0ea3-4ece-859d-0cbffd9149a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406ff931-0ea3-4ece-859d-0cbffd9149a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07487352-4682-4dfb-bcd9-ee925007a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Volume fc534586-c9ee-473a-9b38-bf6b11ee89a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4', 'volume_size': 1}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,created_at=2026-07-02T02:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878671115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=25d73bff-b88b-4f45-8503-4139c0b9b0d8,host='devstack@QuobyteHD#QuobyteHD',id=fc534586-c9ee-473a-9b38-bf6b11ee89a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:43:37Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(901759f6-4b89-4d1e-a443-a13ab5d004e7),volume_type_id=901759f6-4b89-4d1e-a443-a13ab5d004e7)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Creating volume fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:43:37 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:37 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 1073741824
Jul 02 04:43:37 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:37 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6" returned: 0 in 1.004s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:38 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6
Jul 02 04:43:38 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "cinder-3b626a36-afb7-4d9f-8198-e5511d6df0e2-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "cinder-3b626a36-afb7-4d9f-8198-e5511d6df0e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "cinder-quobyte-3b626a36-afb7-4d9f-8198-e5511d6df0e2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "cinder-quobyte-3b626a36-afb7-4d9f-8198-e5511d6df0e2" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4542ff7-cc2f-4a03-badf-cc66bd716269]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:38 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 1073741824" returned: 0 in 1.052s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:38 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4
Jul 02 04:43:38 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:38 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2
Jul 02 04:43:38 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:38 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.9f304695-d278-45ae-aa02-eab1a97d24d6" returned: 0 in 0.920s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-9f304695-d278-45ae-aa02-eab1a97d24d6" released by "_delete_snapshot" :: held 3.893s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_snapshot" :: held 3.919s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Created reservations ['bb97348c-1085-498e-8c0c-249005efc599', 'baf9da2f-137d-4507-926c-171c53a3de12', '07865882-caf3-46d5-b744-dd9bf6431aa4', '303a2e65-8d8d-4981-8bde-e7fd323d9b66'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Delete snapshot completed successfully.
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b954baf4-63f5-453e-ac7d-e9f84a5de7b4 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-9f304695-d278-45ae-aa02-eab1a97d24d6-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:39 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4" returned: 0 in 0.680s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07487352-4682-4dfb-bcd9-ee925007a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976709c4-7b3b-48cd-88a7-02f89d2e87a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:43:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Volume volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 (fc534586-c9ee-473a-9b38-bf6b11ee89a4): created successfully
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976709c4-7b3b-48cd-88a7-02f89d2e87a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (4646a0ee-0bc4-4c6e-99b9-cceaf06de92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:43:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-29a26a8e-202e-4d06-bdbe-e850e4b51769 tempest-GroupSnapshotsTest-1279672838 None] Created volume successfully.
Jul 02 04:43:39 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2" returned: 0 in 0.935s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:39 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2
Jul 02 04:43:39 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Creating offline snapshot 7644e238-baf7-42f4-a577-f09ffe3630a4 of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e84e2-bdb4-47fb-b0ef-6d6e7020ac74]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4df113a8-111f-44f4-a08b-af8e38a07625 tempest-GroupSnapshotsTest-1279672838 None] Update group completed successfully.
Jul 02 04:43:39 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:39 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:40 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3b626a36-afb7-4d9f-8198-e5511d6df0e2" returned: 0 in 0.764s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "cinder-quobyte-3b626a36-afb7-4d9f-8198-e5511d6df0e2" released by "delete_volume" :: held 1.781s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Created reservations ['b898e994-6d33-40aa-af6b-cbc0e2b84ef3', 'ce494cab-594b-4ae8-bf6e-06fd8d138747', 'ab3e1750-b206-40b9-865b-756bde0ec569', 'e22d5027-aacd-4bc4-bae0-4db0375136c9'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:40 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:43:40 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:40 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.979s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:40 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 1G
Jul 02 04:43:40 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a8e2b8ca-97b8-4a02-aa36-8e8634489520 tempest-GroupSnapshotsTest-1279672838 None] Update group completed successfully.
Jul 02 04:43:41 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.945s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:41 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:43:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Deleted volume successfully.
Jul 02 04:43:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-431ca8db-5445-4e4e-8b48-a545ac16af0a tempest-DeleteServersTestJSON-1092277772 None] Lock "cinder-3b626a36-afb7-4d9f-8198-e5511d6df0e2-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 1G" returned: 0 in 1.111s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:41 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:41 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4
Jul 02 04:43:41 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:42 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-54eb9d8b-13a0-4bd9-a5e0-32d95f0e7f6b tempest-GroupSnapshotsTest-1279672838 None] Update group completed successfully.
Jul 02 04:43:42 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4" returned: 0 in 0.793s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:42 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 is being set with open permissions: ugo+rw
Jul 02 04:43:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:42 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4
Jul 02 04:43:42 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:43 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4" returned: 0 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.832s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-834874d0-dac1-4417-a773-b7258e6e3a4b tempest-SnapshotsActionsTest-2127542035 None] Create snapshot completed successfully
Jul 02 04:43:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1426f508-cc07-48ff-9866-5a9c9fdfaad2 tempest-GroupSnapshotsTest-1279672838 None] Update group completed successfully.
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-7644e238-baf7-42f4-a577-f09ffe3630a4-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-7644e238-baf7-42f4-a577-f09ffe3630a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-7644e238-baf7-42f4-a577-f09ffe3630a4" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-7644e238-baf7-42f4-a577-f09ffe3630a4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Deleting offline snapshot 7644e238-baf7-42f4-a577-f09ffe3630a4 of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] snapshot_file for this snap is: volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9479421b-89a6-4055-beea-2139b953a0f7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:44 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4
Jul 02 04:43:44 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:45 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4" returned: 0 in 1.210s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa08593-77bc-4ea9-9e30-7262aec9012d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] GroupSnapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: creating.
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Group snapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: creating. {{(pid=86158) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Creating offline snapshot 60c6db1f-9298-498b-be41-ad237fefb965 of volume fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:45 devstack sudo[88296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:45 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f56ec-59e6-491b-93a4-02da396c718d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:45 devstack sudo[88304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4
Jul 02 04:43:45 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:46 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 1.084s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:46 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4
Jul 02 04:43:46 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:46 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4" returned: 0 in 1.003s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:46 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 1G
Jul 02 04:43:46 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:47 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4" returned: 0 in 1.185s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:47 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4
Jul 02 04:43:47 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:48 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 1G" returned: 0 in 1.418s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:48 devstack sudo[88325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965
Jul 02 04:43:48 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:48 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.7644e238-baf7-42f4-a577-f09ffe3630a4" returned: 0 in 0.917s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-7644e238-baf7-42f4-a577-f09ffe3630a4" released by "_delete_snapshot" :: held 4.558s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_snapshot" :: held 4.599s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Created reservations ['6cb104a4-1c58-4756-b834-68a1061920a0', 'c7530b24-9def-424a-b77b-1be4724f8e18', '2107f88f-553e-4695-b216-6d0aad722299', '34309412-0ba7-4a21-9099-8845b070e5d8'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:43:48 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Delete snapshot completed successfully.
Jul 02 04:43:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2ad60d8b-2d3d-4628-bb24-24b62e881cc0 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-7644e238-baf7-42f4-a577-f09ffe3630a4-delete_snapshot" released by "delete_snapshot" :: held 4.823s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:43:49 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965" returned: 0 in 0.935s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:49 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:49 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965
Jul 02 04:43:49 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:49 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965" returned: 0 in 0.833s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:50 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info
Jul 02 04:43:50 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:50 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info" returned: 0 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:50 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:50 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info
Jul 02 04:43:50 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:51 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.info" returned: 0 in 0.760s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.844s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Creating offline snapshot 8e8f604f-0102-403f-a23f-51dfe4d728f2 of volume 88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d49fd4-573c-425a-ad97-7cee71d71d34]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:51 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f
Jul 02 04:43:51 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:51 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:43:51 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:52 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f" returned: 0 in 0.831s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:52 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 1G
Jul 02 04:43:52 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:52 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 8 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:43:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:43:53 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 1G" returned: 0 in 1.070s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88941219-a6e8-4a97-bb59-b75d26aef43f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:53 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88941219-a6e8-4a97-bb59-b75d26aef43f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2
Jul 02 04:43:53 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:54 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88941219-a6e8-4a97-bb59-b75d26aef43f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2" returned: 0 in 0.966s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:54 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:54 devstack sudo[88361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2
Jul 02 04:43:54 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:55 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2" returned: 0 in 0.720s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:55 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info
Jul 02 04:43:55 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:55 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info" returned: 0 in 0.684s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:55 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:43:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:55 devstack sudo[88367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info
Jul 02 04:43:55 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:56 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.info" returned: 0 in 0.736s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.116s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.717s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Creating offline snapshot 61378791-3d68-4344-abe9-65b5968b173e of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4451a4b4-f498-4fef-82de-c084b3185f95]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:57 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:43:57 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0dc627ff-63a6-4bb7-a40e-4da1f8c47e77 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: created successfully
Jul 02 04:43:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: deleting
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: deleting {{(pid=86158) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-60c6db1f-9298-498b-be41-ad237fefb965" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-60c6db1f-9298-498b-be41-ad237fefb965" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Deleting offline snapshot 60c6db1f-9298-498b-be41-ad237fefb965 of volume fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] snapshot_file for this snap is: volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc28dde-eb0c-4579-a17c-6f49983a3164]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:57 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 1.108s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:57 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e 1G
Jul 02 04:43:57 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:57 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965
Jul 02 04:43:57 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:58 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965" returned: 0 in 1.104s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:43:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc280c-8d42-4eee-bade-c7173f035ebc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:43:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:59 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4
Jul 02 04:43:59 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:59 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e 1G" returned: 0 in 1.210s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:59 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e
Jul 02 04:43:59 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:43:59 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Jul 02 04:43:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4" returned: 0 in 0.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:43:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:43:59 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965
Jul 02 04:43:59 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:00 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e" returned: 0 in 0.972s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:00 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e is being set with open permissions: ugo+rw
Jul 02 04:44:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:00 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e
Jul 02 04:44:00 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:00 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965" returned: 0 in 0.993s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:00 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965
Jul 02 04:44:00 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:00 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e" returned: 0 in 0.853s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e6c73922-11ef-465c-96a8-a03045135162 tempest-SnapshotsActionsTest-2127542035 None] Create snapshot completed successfully
Jul 02 04:44:01 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4.60c6db1f-9298-498b-be41-ad237fefb965" returned: 0 in 0.774s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-60c6db1f-9298-498b-be41-ad237fefb965" released by "_delete_snapshot" :: held 3.984s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" released by "delete_snapshot" :: held 4.019s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-8e8f604f-0102-403f-a23f-51dfe4d728f2" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-61378791-3d68-4344-abe9-65b5968b173e-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-8e8f604f-0102-403f-a23f-51dfe4d728f2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Deleting offline snapshot 8e8f604f-0102-403f-a23f-51dfe4d728f2 of volume 88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] snapshot_file for this snap is: volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-61378791-3d68-4344-abe9-65b5968b173e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c2684f-2bbd-4747-8cc0-aee13656f1ef]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-61378791-3d68-4344-abe9-65b5968b173e" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-61378791-3d68-4344-abe9-65b5968b173e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Deleting offline snapshot 61378791-3d68-4344-abe9-65b5968b173e of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] snapshot_file for this snap is: volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7e3a4-c040-4e16-b618-4c513d5d6c5d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:02 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2
Jul 02 04:44:02 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:02 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e
Jul 02 04:44:02 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:02 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e" returned: 0 in 0.932s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:02 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[44612adb-b579-4771-8739-869b73848431]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:03 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2" returned: 0 in 1.164s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88941219-a6e8-4a97-bb59-b75d26aef43f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:03 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:03 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28213262-9975-480c-bf39-7fcfce5626e9]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:03 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f
Jul 02 04:44:03 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:03 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.926s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:03 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e
Jul 02 04:44:03 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:04 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f" returned: 0 in 1.123s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:04 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2
Jul 02 04:44:04 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:04 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e" returned: 0 in 1.133s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:05 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e
Jul 02 04:44:05 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:05 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2" returned: 0 in 1.050s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:05 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2
Jul 02 04:44:05 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:05 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.61378791-3d68-4344-abe9-65b5968b173e" returned: 0 in 0.896s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-61378791-3d68-4344-abe9-65b5968b173e" released by "_delete_snapshot" :: held 4.070s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_snapshot" :: held 4.112s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Created reservations ['b1d403df-5144-40d3-bdb4-da82e2cb0c7a', 'd5290efb-3d7c-4a45-82f4-beaafd5f2ed0', '87fd1727-6f7d-46c8-936b-c786f97dc8e1', '9ab37864-81d8-49e9-8a77-ed1d1da6ccb2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:06 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Delete snapshot completed successfully.
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f.8e8f604f-0102-403f-a23f-51dfe4d728f2" returned: 0 in 0.907s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2f732271-21b5-4690-9b05-de8a295ebb10 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-61378791-3d68-4344-abe9-65b5968b173e-delete_snapshot" released by "delete_snapshot" :: held 4.337s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-8e8f604f-0102-403f-a23f-51dfe4d728f2" released by "_delete_snapshot" :: held 4.400s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" released by "delete_snapshot" :: held 4.450s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:06 devstack cinder-volume[86158]: WARNING cinder.quota [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-557158118 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-557158118, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:06 devstack cinder-volume[86158]: WARNING cinder.quota [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-557158118 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-557158118, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['6d76d0a9-a617-4488-9dcc-fb932ce6f764', '8728164c-e392-46cd-b5b7-63ff8f487491', 'fcbb74aa-dd63-4789-a9da-ecb1b1c106cb', 'a102f1b4-ac6f-43fd-a5b6-f7cd7033f248'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:06 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['fac09d7e-bfaf-4006-8a2f-adfe4c8de7db', '58dedb26-58fc-47a7-b8ff-d618889591c1', 'b6e79ea2-9443-4a4d-ad63-96bb1f8c9593', '15b59eb5-e466-4711-b737-f1efdc58d45e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8f8a907e-105d-46ce-a1a1-7f08fd133f5a tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 57fc681e-e2d1-4e89-999b-e5526dc483d6: deleted successfully
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Creating offline snapshot 63dc005c-a364-49e7-8d06-396fd149290c of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794e92b-07aa-4cd8-93bd-e1dabb2b691c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:07 devstack sudo[88463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:07 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f34bf56-5915-40bf-8df9-4e8835316b72]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:08 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f
Jul 02 04:44:08 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:08 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.905s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:08 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c 1G
Jul 02 04:44:08 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:08 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f" returned: 0 in 0.824s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:08 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f
Jul 02 04:44:08 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:09 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c 1G" returned: 0 in 0.911s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:09 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c
Jul 02 04:44:09 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:09 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-88941219-a6e8-4a97-bb59-b75d26aef43f" returned: 0 in 0.768s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-88941219-a6e8-4a97-bb59-b75d26aef43f" released by "delete_volume" :: held 1.667s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265c87f-3ae9-415a-9ef8-013a8faf02dc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:09 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4
Jul 02 04:44:09 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:10 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c" returned: 0 in 0.706s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:10 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c is being set with open permissions: ugo+rw
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:10 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c
Jul 02 04:44:10 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:10 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4" returned: 0 in 1.066s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:10 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4
Jul 02 04:44:10 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:10 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c" returned: 0 in 0.841s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.498s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5e73c6c5-a05a-4f61-a28d-edd6fbea111d tempest-SnapshotsActionsTest-2127542035 None] Create snapshot completed successfully
Jul 02 04:44:11 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc534586-c9ee-473a-9b38-bf6b11ee89a4" returned: 0 in 0.695s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-fc534586-c9ee-473a-9b38-bf6b11ee89a4" released by "delete_volume" :: held 1.841s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['68c4364b-b8fc-4861-8671-b786de010880'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:11 devstack cinder-volume[86158]: WARNING cinder.quota [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-557158118 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-557158118, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['88f19856-c9ad-417d-ae23-9aad2ecb357a', 'a66306c7-3580-4732-88df-4266ba4fe9c0', '623fd736-5f51-44af-9f2b-f7a89f8fec89', '96a4a760-eef9-43a0-9ead-c10db2714116'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['4491bfc6-73f9-4719-b4d7-0fcd3c2ca7d9', 'f4329b62-9d62-4da3-8108-bb7ec0dc29fc', '303ccb71-f2d0-46a5-9d32-a54fc0e17eb1', '20bebf0b-e9d3-4fbb-ade3-3dfdde55be56'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-63dc005c-a364-49e7-8d06-396fd149290c-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-63dc005c-a364-49e7-8d06-396fd149290c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Acquiring lock "cinder-quobyte-63dc005c-a364-49e7-8d06-396fd149290c" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-63dc005c-a364-49e7-8d06-396fd149290c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Deleting offline snapshot 63dc005c-a364-49e7-8d06-396fd149290c of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] snapshot_file for this snap is: volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84154db-1d80-48a2-b34d-b7dd3e2160d2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:12 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:12 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:12 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c
Jul 02 04:44:12 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:13 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.863s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2e3e16e9-5624-4d27-b74d-7a580781274b tempest-GroupSnapshotsTest-1279672838 None] Delete group completed successfully.
Jul 02 04:44:13 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c" returned: 0 in 1.038s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9c3bb6-1ac5-4eb5-816f-4a278b7c0c8d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:13 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:13 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-99165d53-f957-4d8d-9f02-7435a3d4a924 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-1527555955: creating
Jul 02 04:44:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-99165d53-f957-4d8d-9f02-7435a3d4a924 tempest-GroupSnapshotsTest-1279672838 None] Group tempest-GroupSnapshotsTest-Group-1527555955: created successfully
Jul 02 04:44:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-99165d53-f957-4d8d-9f02-7435a3d4a924 tempest-GroupSnapshotsTest-1279672838 None] Create group completed successfully.
Jul 02 04:44:14 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.972s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:14 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c
Jul 02 04:44:14 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:15 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c" returned: 0 in 0.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:15 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c
Jul 02 04:44:15 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (47f10810-57cf-4f14-9071-b437a38f693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a2c7ba-56a2-45db-965c-ce9b1538ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a2c7ba-56a2-45db-965c-ce9b1538ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526840044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41e3fac5-34c1-45a3-9a41-b48bea283354,host='devstack@QuobyteHD#QuobyteHD',id=b6bce812-9a52-4f99-9e53-a1192aa361b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:16Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9342a5b-d49c-49ca-b812-0bb0fe8bd0ff),volume_type_id=e9342a5b-d49c-49ca-b812-0bb0fe8bd0ff)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b89a3bd-ca12-4209-b2d0-808225eaecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b89a3bd-ca12-4209-b2d0-808225eaecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c89af79-ece7-4842-930b-be8769c6cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c89af79-ece7-4842-930b-be8769c6cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bce812-9a52-4f99-9e53-a1192aa361b8', 'volume_name': 'volume-b6bce812-9a52-4f99-9e53-a1192aa361b8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741ac23c-38e2-43d0-8887-e3a1b472e54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741ac23c-38e2-43d0-8887-e3a1b472e54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d8a0aa-0376-40bb-9fa2-19007b964e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:15 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Volume b6bce812-9a52-4f99-9e53-a1192aa361b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bce812-9a52-4f99-9e53-a1192aa361b8', 'volume_size': 1}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41e3fac5-34c1-45a3-9a41-b48bea283354,created_at=2026-07-02T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526840044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41e3fac5-34c1-45a3-9a41-b48bea283354,host='devstack@QuobyteHD#QuobyteHD',id=b6bce812-9a52-4f99-9e53-a1192aa361b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001401e836545908611738054933c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:16Z,use_quota=True,user_id='a0b9ac34428d4da09996da6054895a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9342a5b-d49c-49ca-b812-0bb0fe8bd0ff),volume_type_id=e9342a5b-d49c-49ca-b812-0bb0fe8bd0ff)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Creating volume b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:15 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:15 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 1073741824
Jul 02 04:44:15 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:16 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.63dc005c-a364-49e7-8d06-396fd149290c" returned: 0 in 0.822s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-63dc005c-a364-49e7-8d06-396fd149290c" released by "_delete_snapshot" :: held 4.034s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_snapshot" :: held 4.073s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Created reservations ['e79c0973-f1e5-4fd1-81e2-eea22c84154c', '863452a6-bd7d-4d37-8881-b63dbca006c2', '4856ba18-54e5-4806-ae15-503175b14481', 'fc826b11-0415-4976-8daf-6bf32c9ef7b3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Delete snapshot completed successfully.
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2298a3bb-6144-468e-b487-ea06c4cccc70 tempest-SnapshotsActionsTest-1587654062 None] Lock "cinder-63dc005c-a364-49e7-8d06-396fd149290c-delete_snapshot" released by "delete_snapshot" :: held 4.286s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:16 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 1073741824" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:16 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8
Jul 02 04:44:16 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:17 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8" returned: 0 in 0.694s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d8a0aa-0376-40bb-9fa2-19007b964e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bce812-9a52-4f99-9e53-a1192aa361b8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1da1e50-e5f4-452a-837e-1b191cf5cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:17 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Volume volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 (b6bce812-9a52-4f99-9e53-a1192aa361b8): created successfully
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1da1e50-e5f4-452a-837e-1b191cf5cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Flow 'volume_create_manager' (47f10810-57cf-4f14-9071-b437a38f693a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:17 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-84e6a6fa-6a9f-4052-81de-ccc93a397255 tempest-GroupSnapshotsTest-1279672838 None] Created volume successfully.
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "cinder-84507656-a6a6-489f-a5ea-b0acd69af96f-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-84507656-a6a6-489f-a5ea-b0acd69af96f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "cinder-quobyte-84507656-a6a6-489f-a5ea-b0acd69af96f" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-84507656-a6a6-489f-a5ea-b0acd69af96f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Deleting offline snapshot 84507656-a6a6-489f-a5ea-b0acd69af96f of volume de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] snapshot_file for this snap is: volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a81bfc-bde2-4d01-9298-b2361a2ed787]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:17 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:17 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] GroupSnapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: creating.
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Group snapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: creating. {{(pid=86158) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Creating offline snapshot 6e5a67b7-00df-49d3-87bf-c069ace6fdf4 of volume b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56bf9f-5303-4293-9a49-e60c64c0060a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:18 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8
Jul 02 04:44:18 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:18 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 0.994s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3fc634-d98d-4fc8-aba4-babc93e8600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e9abc-d770-4e91-882f-994ab2a26fb6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:19 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c
Jul 02 04:44:19 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:20 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8" returned: 0 in 2.030s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:20 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 1G
Jul 02 04:44:20 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c" returned: 0 in 1.817s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:20 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:20 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:20 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:22 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 1G" returned: 0 in 1.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:22 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4
Jul 02 04:44:22 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:22 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 1.582s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:22 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f
Jul 02 04:44:22 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:23 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c.84507656-a6a6-489f-a5ea-b0acd69af96f" returned: 0 in 1.308s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=121,cinder:SELECT=127,cinder:DELETE=6,cinder:INSERT=33 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=116,cinder:UPDATE=114,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-84507656-a6a6-489f-a5ea-b0acd69af96f" released by "_delete_snapshot" :: held 5.904s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_snapshot" :: held 5.944s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:23 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4" returned: 0 in 1.599s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:23 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:23 devstack sudo[88789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4
Jul 02 04:44:23 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Created reservations ['effaca8a-e99d-4073-a83e-1c4bb96d5a82', 'a811eed2-59df-4ba6-af81-abf55f1a9519', '7941fd0e-f600-4c62-bc52-4fa9408eb591', '85262979-c75a-4ac9-8fa2-d00b08ae40e0'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Delete snapshot completed successfully.
Jul 02 04:44:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95daae6a-3323-48a4-aef4-f911a3a5fa9e tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-84507656-a6a6-489f-a5ea-b0acd69af96f-delete_snapshot" released by "delete_snapshot" :: held 6.236s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "cinder-de3fc634-d98d-4fc8-aba4-babc93e8600c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-de3fc634-d98d-4fc8-aba4-babc93e8600c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" acquired by "delete_volume" :: waited 0.041s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7914d98-4dbc-43d7-901d-bec0d6b0894a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:25 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4" returned: 0 in 1.324s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:25 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c
Jul 02 04:44:25 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:25 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info
Jul 02 04:44:25 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:25 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Flow 'volume_create_manager' (783f3ff9-ede7-49f1-adc9-887e6fd0560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793885f-0d01-43ee-86e2-9ea723cd077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f793885f-0d01-43ee-86e2-9ea723cd077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1353327826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1fc50a-dc76-484a-b58e-315b8da397fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0da0a9813c403f84eecf6cda90341b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:26Z,use_quota=True,user_id='88c289cf0703416ea17b25999f729641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab81c8c-b7d6-41c7-87ec-5de7ac98ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab81c8c-b7d6-41c7-87ec-5de7ac98ae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900e964a-048e-442a-b9d9-7ce4d460ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900e964a-048e-442a-b9d9-7ce4d460ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1fc50a-dc76-484a-b58e-315b8da397fa', 'volume_name': 'volume-5e1fc50a-dc76-484a-b58e-315b8da397fa', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7a737b-1020-41f3-ac42-6751ed051b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7a737b-1020-41f3-ac42-6751ed051b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ee5823-df2f-4647-9a5b-4843c1d98f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Volume 5e1fc50a-dc76-484a-b58e-315b8da397fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1fc50a-dc76-484a-b58e-315b8da397fa', 'volume_size': 1}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:26 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info" returned: 0 in 1.375s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:26 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:26 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info
Jul 02 04:44:26 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:26 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c" returned: 0 in 1.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:26 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c
Jul 02 04:44:26 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:27 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.info" returned: 0 in 0.986s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.147s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1353327826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1fc50a-dc76-484a-b58e-315b8da397fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0da0a9813c403f84eecf6cda90341b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:26Z,use_quota=True,user_id='88c289cf0703416ea17b25999f729641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Creating volume 5e1fc50a-dc76-484a-b58e-315b8da397fa {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:27 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:27 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa 1073741824
Jul 02 04:44:27 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-66784afd-dde3-42cf-aafd-2677a008be63 tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: created successfully
Jul 02 04:44:27 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de3fc634-d98d-4fc8-aba4-babc93e8600c" returned: 0 in 0.918s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-quobyte-de3fc634-d98d-4fc8-aba4-babc93e8600c" released by "delete_volume" :: held 3.064s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Created reservations ['c051a507-660f-4c12-8cac-67452271c7bf', 'd01b381e-b6a2-4692-85c0-8755261b34b8', '8e00608e-67ae-4618-b9d5-23956308df15', 'd9d609d4-a73c-4cd2-ad24-40b6a96a2b40'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:28 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:28 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: deleting
Jul 02 04:44:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: deleting {{(pid=86158) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 04:44:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-6e5a67b7-00df-49d3-87bf-c069ace6fdf4" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-6e5a67b7-00df-49d3-87bf-c069ace6fdf4" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Deleting offline snapshot 6e5a67b7-00df-49d3-87bf-c069ace6fdf4 of volume b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] snapshot_file for this snap is: volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0288e0-12d1-4295-b9a9-1036f4bae88e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:29 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4
Jul 02 04:44:29 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:29 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.631s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Deleted volume successfully.
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-10183660-a27e-44ef-9157-fbfbc757573c tempest-SnapshotsActionsTest-2127542035 None] Lock "cinder-de3fc634-d98d-4fc8-aba4-babc93e8600c-delete_volume" released by "delete_volume" :: held 5.132s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:29 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa 1073741824" returned: 0 in 2.260s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:29 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa
Jul 02 04:44:29 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:30 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4" returned: 0 in 1.399s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6bce812-9a52-4f99-9e53-a1192aa361b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e18798f-47e0-40b1-8e93-c532d9a866d5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa" returned: 0 in 1.044s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.372s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:30 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:30 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8
Jul 02 04:44:30 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ee5823-df2f-4647-9a5b-4843c1d98f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1fc50a-dc76-484a-b58e-315b8da397fa', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7613b323-92a6-4c64-9a93-57610647ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Volume volume-5e1fc50a-dc76-484a-b58e-315b8da397fa (5e1fc50a-dc76-484a-b58e-315b8da397fa): created successfully
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7613b323-92a6-4c64-9a93-57610647ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Flow 'volume_create_manager' (783f3ff9-ede7-49f1-adc9-887e6fd0560a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5ee1776a-ee22-4382-9167-cecd6bcde06d tempest-VolumesAdminNegativeTest-1625189844 None] Created volume successfully.
Jul 02 04:44:31 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8" returned: 0 in 1.155s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:31 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4
Jul 02 04:44:31 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Acquiring lock "cinder-5e1fc50a-dc76-484a-b58e-315b8da397fa-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "cinder-5e1fc50a-dc76-484a-b58e-315b8da397fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Acquiring lock "cinder-quobyte-5e1fc50a-dc76-484a-b58e-315b8da397fa" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "cinder-quobyte-5e1fc50a-dc76-484a-b58e-315b8da397fa" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45405a3-7996-4dc7-accb-8a8bc9795956]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:32 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa
Jul 02 04:44:32 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:33 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4" returned: 0 in 1.499s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:33 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4
Jul 02 04:44:33 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:34 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa" returned: 0 in 1.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:34 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa
Jul 02 04:44:34 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:34 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8.6e5a67b7-00df-49d3-87bf-c069ace6fdf4" returned: 0 in 1.377s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-6e5a67b7-00df-49d3-87bf-c069ace6fdf4" released by "_delete_snapshot" :: held 5.650s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" released by "delete_snapshot" :: held 5.745s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:34 devstack cinder-volume[86158]: WARNING cinder.quota [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-679610373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-679610373, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:34 devstack cinder-volume[86158]: WARNING cinder.quota [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-679610373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-679610373, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:34 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['f9b07f6e-2b8c-4630-b0af-eee0deff2ff7', 'c67038ad-7e7e-444a-aa5f-9f0433f6ad66', '531fd0e5-cee6-44c4-8f1a-2fb661bb378d', '103d2262-7dc5-453d-b4b4-854ee038e1f5'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-74ddd82e-70fc-493f-981d-9454e97a2bce tempest-GroupSnapshotsTest-1279672838 None] group_snapshot 05ba1f86-b3a6-4fa6-a9be-50771e336a1f: deleted successfully
Jul 02 04:44:35 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5e1fc50a-dc76-484a-b58e-315b8da397fa" returned: 0 in 0.834s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "cinder-quobyte-5e1fc50a-dc76-484a-b58e-315b8da397fa" released by "delete_volume" :: held 2.614s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Created reservations ['77c9dc47-03fe-473a-b655-76ca36b947a5', '14d3358a-eb4f-441d-8139-7a51c2099543', '16877404-a5de-428e-a980-c923dd509336', 'db23d405-23e8-4640-ad12-b88423024ce8'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:35 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:35 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:36 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.868s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Deleted volume successfully.
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cd5eb151-6882-4138-9226-5253beac5b54 tempest-VolumesAdminNegativeTest-1625189844 None] Lock "cinder-5e1fc50a-dc76-484a-b58e-315b8da397fa-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ea50b-25d0-42e2-8dd1-e26e87220ee3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:36 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8
Jul 02 04:44:36 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:37 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8" returned: 0 in 1.250s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:37 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8
Jul 02 04:44:37 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:38 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b6bce812-9a52-4f99-9e53-a1192aa361b8" returned: 0 in 1.001s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Lock "cinder-quobyte-b6bce812-9a52-4f99-9e53-a1192aa361b8" released by "delete_volume" :: held 2.386s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['2cfc7d9a-a886-4b49-b491-c2747310477d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:39 devstack cinder-volume[86158]: WARNING cinder.quota [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-679610373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-679610373, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Created reservations ['c33a9a94-68ce-4b04-a8d4-3a6213731c3e', '3b8ee2ad-dcd5-4ded-81f1-3b5d33b64efd', '628892b2-fcc2-471d-81f8-ebc20830b345', '84329cc1-d346-4c89-ab18-35a2a481cfdd'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:39 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:39 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:40 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.838s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:40 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6b2ba0f3-29a7-4fc9-b69d-7ace6bde2572 tempest-GroupSnapshotsTest-1279672838 None] Delete group completed successfully.
Jul 02 04:44:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Flow 'volume_create_manager' (766a9810-da8c-4abc-80a5-b08a331c45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c2c0b0-5417-43e8-99be-969cc961fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c2c0b0-5417-43e8-99be-969cc961fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-307677038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d3c4f9-3e3f-49f2-b7eb-c9de94c639af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce852d920045b79f332fc2bd8d16f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:47Z,use_quota=True,user_id='9275ef5f099e484e813c6c067875269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c08d18-3906-4611-9cec-531e682591a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c08d18-3906-4611-9cec-531e682591a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bee2591-aba4-48f7-bcfd-414d4e7e14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bee2591-aba4-48f7-bcfd-414d4e7e14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d3c4f9-3e3f-49f2-b7eb-c9de94c639af', 'volume_name': 'volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7066b23-6d31-419f-810d-f6eaa1b3c583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7066b23-6d31-419f-810d-f6eaa1b3c583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cad19c-95ea-4343-850c-196e07392398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume 65d3c4f9-3e3f-49f2-b7eb-c9de94c639af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af', 'volume_size': 1}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-307677038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d3c4f9-3e3f-49f2-b7eb-c9de94c639af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce852d920045b79f332fc2bd8d16f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:47Z,use_quota=True,user_id='9275ef5f099e484e813c6c067875269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Creating volume 65d3c4f9-3e3f-49f2-b7eb-c9de94c639af {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:47 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:47 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af 1073741824
Jul 02 04:44:47 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Flow 'volume_create_manager' (e99df173-b350-42ea-8cf1-0d4563496d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b46c81-a19e-49c9-85aa-e53638b9cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b46c81-a19e-49c9-85aa-e53638b9cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2015255215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6e80bb-9940-4fdf-8ded-a30b045d8701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e52d7a009c1479db54d36b801ac81c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:48Z,use_quota=True,user_id='1ce1dff19baf4903b164569aee03b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e839c285-3541-46ac-aa47-8f2a742a2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e839c285-3541-46ac-aa47-8f2a742a2661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de76c39a-ac7d-4586-9db3-f3f1f51030b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de76c39a-ac7d-4586-9db3-f3f1f51030b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6e80bb-9940-4fdf-8ded-a30b045d8701', 'volume_name': 'volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3077eb4-c5ee-4f18-86f4-537c76fb86a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3077eb4-c5ee-4f18-86f4-537c76fb86a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d63dc7-3daa-46a0-95c9-6bfa6ad604ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:47 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Volume 2d6e80bb-9940-4fdf-8ded-a30b045d8701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701', 'volume_size': 1}
Jul 02 04:44:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:48 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af 1073741824" returned: 0 in 1.270s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:48 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af
Jul 02 04:44:48 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:49 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" returned: 0 in 0.786s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.567s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2015255215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6e80bb-9940-4fdf-8ded-a30b045d8701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e52d7a009c1479db54d36b801ac81c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:48Z,use_quota=True,user_id='1ce1dff19baf4903b164569aee03b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Creating volume 2d6e80bb-9940-4fdf-8ded-a30b045d8701 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:49 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 1073741824
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cad19c-95ea-4343-850c-196e07392398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:49 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bf46a4-f433-4aa1-88db-5a8131c21214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af (65d3c4f9-3e3f-49f2-b7eb-c9de94c639af): created successfully
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bf46a4-f433-4aa1-88db-5a8131c21214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Flow 'volume_create_manager' (766a9810-da8c-4abc-80a5-b08a331c45f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3e832b2d-392a-4bc2-9db6-08b57b9d23db tempest-VolumeQuotasAdminTestJSON-1602236519 None] Created volume successfully.
Jul 02 04:44:50 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 1073741824" returned: 0 in 1.015s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "cinder-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "cinder-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:50 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701
Jul 02 04:44:50 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "cinder-quobyte-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "cinder-quobyte-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d1e6e-cf29-4620-90af-d9d573d12469]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:50 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af
Jul 02 04:44:50 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:51 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701" returned: 0 in 0.745s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d63dc7-3daa-46a0-95c9-6bfa6ad604ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44960865-8d4d-4f9d-9173-3a5e485ae656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Volume volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 (2d6e80bb-9940-4fdf-8ded-a30b045d8701): created successfully
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44960865-8d4d-4f9d-9173-3a5e485ae656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Flow 'volume_create_manager' (e99df173-b350-42ea-8cf1-0d4563496d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-13b2bfe6-1d00-4b83-9c02-db079deade6a tempest-AttachVolumeShelveTestJSON-1744985770 None] Created volume successfully.
Jul 02 04:44:51 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" returned: 0 in 0.946s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:51 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af
Jul 02 04:44:51 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:51 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:51 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-af8a5594-7c21-42c7-8184-f9bd8d4b56ac tempest-GroupsTest-2029654891 None] Group tempest-Group1-1872123879: creating
Jul 02 04:44:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-af8a5594-7c21-42c7-8184-f9bd8d4b56ac tempest-GroupsTest-2029654891 None] Group tempest-Group1-1872123879: created successfully
Jul 02 04:44:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-af8a5594-7c21-42c7-8184-f9bd8d4b56ac tempest-GroupsTest-2029654891 None] Create group completed successfully.
Jul 02 04:44:52 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" returned: 0 in 0.817s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "cinder-quobyte-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af" released by "delete_volume" :: held 1.830s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Created reservations ['a467a5df-5e87-4d01-9f6d-07c429aa06c3', 'b87f0e7b-db50-4652-8198-a2849532281c', 'c1b22cbd-cace-414d-a8c8-cd0506de52bc', '08196ce9-9d6e-4aba-a118-ef49063ad72f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:52 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:44:52 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:52 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.109s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 8 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:44:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Flow 'volume_create_manager' (04bc938c-0068-4b8a-933b-cf0caf7d8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d046fa8-de06-4690-9353-f7c391d39b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d046fa8-de06-4690-9353-f7c391d39b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-187604850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441defe0-1791-49f7-a2c3-74757fa7c780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce852d920045b79f332fc2bd8d16f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:53Z,use_quota=True,user_id='9275ef5f099e484e813c6c067875269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afcc6f6-0e80-48b0-8878-406d3390d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afcc6f6-0e80-48b0-8878-406d3390d069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221cd5f5-1195-4f23-949e-5cb4a15739d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221cd5f5-1195-4f23-949e-5cb4a15739d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441defe0-1791-49f7-a2c3-74757fa7c780', 'volume_name': 'volume-441defe0-1791-49f7-a2c3-74757fa7c780', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4e1c0e-2ee4-456c-8f0c-79ed81ccb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4e1c0e-2ee4-456c-8f0c-79ed81ccb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23452c04-9e64-4b3f-8349-0458177ca046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume 441defe0-1791-49f7-a2c3-74757fa7c780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441defe0-1791-49f7-a2c3-74757fa7c780', 'volume_size': 1}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-187604850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441defe0-1791-49f7-a2c3-74757fa7c780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce852d920045b79f332fc2bd8d16f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:53Z,use_quota=True,user_id='9275ef5f099e484e813c6c067875269d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Creating volume 441defe0-1791-49f7-a2c3-74757fa7c780 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:53 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 1073741824
Jul 02 04:44:53 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:53 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.204s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c57912c2-e56e-4875-8f72-a40272f085fa tempest-GroupsTest-2029654891 None] Group tempest-Group2-1288231640: creating
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Deleted volume successfully.
Jul 02 04:44:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-36c3a0fc-5bba-4c26-9f16-68ae1bfd1257 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "cinder-65d3c4f9-3e3f-49f2-b7eb-c9de94c639af-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c57912c2-e56e-4875-8f72-a40272f085fa tempest-GroupsTest-2029654891 None] Group tempest-Group2-1288231640: created successfully
Jul 02 04:44:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c57912c2-e56e-4875-8f72-a40272f085fa tempest-GroupsTest-2029654891 None] Create group completed successfully.
Jul 02 04:44:54 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 1073741824" returned: 0 in 1.034s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:54 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780
Jul 02 04:44:54 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (ac101e67-53db-4139-a475-07ee195c5c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4c55d-4c41-4257-b402-2fa75f020fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4c55d-4c41-4257-b402-2fa75f020fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678524050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d0777a8e-d6b4-4b59-afac-7be9aa73e6ed,host='devstack@QuobyteHD#QuobyteHD',id=853374cf-25a7-4412-8064-4b3dbc166082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:55Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03fd8fc7-824c-499d-8214-2441a9791313),volume_type_id=03fd8fc7-824c-499d-8214-2441a9791313)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d93ac79-a532-48d5-a5c2-2d242b348597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d93ac79-a532-48d5-a5c2-2d242b348597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bea752a-95ee-4a49-b6be-275ae2158996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bea752a-95ee-4a49-b6be-275ae2158996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853374cf-25a7-4412-8064-4b3dbc166082', 'volume_name': 'volume-853374cf-25a7-4412-8064-4b3dbc166082', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dd43e5-134e-4055-8a4c-3c61963b61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dd43e5-134e-4055-8a4c-3c61963b61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98aeb8f-7b73-41dc-b2a7-528d1418711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Volume 853374cf-25a7-4412-8064-4b3dbc166082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853374cf-25a7-4412-8064-4b3dbc166082', 'volume_size': 1}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:55 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780" returned: 0 in 1.006s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d0777a8e-d6b4-4b59-afac-7be9aa73e6ed,created_at=2026-07-02T02:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678524050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d0777a8e-d6b4-4b59-afac-7be9aa73e6ed,host='devstack@QuobyteHD#QuobyteHD',id=853374cf-25a7-4412-8064-4b3dbc166082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:44:55Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03fd8fc7-824c-499d-8214-2441a9791313),volume_type_id=03fd8fc7-824c-499d-8214-2441a9791313)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Creating volume 853374cf-25a7-4412-8064-4b3dbc166082 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:44:55 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:55 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 1073741824
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23452c04-9e64-4b3f-8349-0458177ca046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441defe0-1791-49f7-a2c3-74757fa7c780', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2e2b4-8046-42fe-ac80-0c0a5ebf6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:55 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Volume volume-441defe0-1791-49f7-a2c3-74757fa7c780 (441defe0-1791-49f7-a2c3-74757fa7c780): created successfully
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2e2b4-8046-42fe-ac80-0c0a5ebf6628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Flow 'volume_create_manager' (04bc938c-0068-4b8a-933b-cf0caf7d8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-da3b37e4-8599-4d84-a5d8-98267e34cd48 tempest-VolumeQuotasAdminTestJSON-1602236519 None] Created volume successfully.
Jul 02 04:44:56 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 1073741824" returned: 0 in 1.009s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:56 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082
Jul 02 04:44:56 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-cfabd02a-8298-49c6-b0fc-4209fb1da075 tempest-VolumeQuotasAdminTestJSON-1984694050 None] Transfer volume completed successfully.
Jul 02 04:44:57 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082" returned: 0 in 0.935s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98aeb8f-7b73-41dc-b2a7-528d1418711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853374cf-25a7-4412-8064-4b3dbc166082', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dbefad-0bab-40fb-aa3e-355741251a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:44:57 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Volume volume-853374cf-25a7-4412-8064-4b3dbc166082 (853374cf-25a7-4412-8064-4b3dbc166082): created successfully
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dbefad-0bab-40fb-aa3e-355741251a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:44:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (ac101e67-53db-4139-a475-07ee195c5c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:44:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f5e4bed7-87c3-42f1-b5ed-286dc7d2dd48 tempest-GroupsTest-2029654891 None] Created volume successfully.
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Acquiring lock "cinder-441defe0-1791-49f7-a2c3-74757fa7c780-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "cinder-441defe0-1791-49f7-a2c3-74757fa7c780-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Acquiring lock "cinder-quobyte-441defe0-1791-49f7-a2c3-74757fa7c780" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "cinder-quobyte-441defe0-1791-49f7-a2c3-74757fa7c780" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f28240-b7d4-4980-b030-04ae2dfbb3e2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:58 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780
Jul 02 04:44:58 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Acquiring lock "cinder-quobyte-853374cf-25a7-4412-8064-4b3dbc166082" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-853374cf-25a7-4412-8064-4b3dbc166082" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeeff79-e6a8-44c5-bd9e-457d0cf9ed1c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:59 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082
Jul 02 04:44:59 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:44:59 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780" returned: 0 in 1.028s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:44:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:44:59 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780
Jul 02 04:44:59 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:00 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:00 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082" returned: 0 in 0.946s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-441defe0-1791-49f7-a2c3-74757fa7c780" returned: 0 in 0.769s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:00 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "cinder-quobyte-441defe0-1791-49f7-a2c3-74757fa7c780" released by "delete_volume" :: held 1.860s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:00 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Created reservations ['c0e3cc1d-6bfa-4396-850e-6f4ed3f8572c', '6ab68457-39ff-4f70-b46f-3e8e884eeaf8', '47f6802d-a8cd-4bd1-9d5e-160cb84cff33', 'd6af361c-b4b5-4e62-ae8a-04a02f82baac'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:00 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:00 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:01 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-853374cf-25a7-4412-8064-4b3dbc166082" returned: 0 in 0.967s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-853374cf-25a7-4412-8064-4b3dbc166082" released by "delete_volume" :: held 1.962s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Created reservations ['435d77b5-c261-4f07-834b-ffe7148f8882'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:01 devstack cinder-volume[86158]: WARNING cinder.quota [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1159177840 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1159177840, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:01 devstack cinder-volume[86158]: WARNING cinder.quota [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1159177840 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1159177840, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Created reservations ['f66707e9-2ee7-452f-abbb-741c18a17c70', 'c51dadd8-1431-4899-b98d-3eccbc202992', '0754ea54-7034-4315-8167-29ec40785d08', '5032270c-e31f-4f27-87db-14a329de8038'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:01 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:01 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:01 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.119s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:01 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Deleted volume successfully.
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ebc19033-cccd-4717-9d2a-a6943dcd2d8a tempest-VolumeQuotasAdminTestJSON-1101082258 None] Lock "cinder-441defe0-1791-49f7-a2c3-74757fa7c780-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Created reservations ['7f425fbb-3203-4365-83e3-bd8b42e487df'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:02 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:02 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:02 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.022s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:02 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bb40ba2f-4bea-40f3-9faf-d6aabe845f17 tempest-GroupsTest-2029654891 None] Delete group completed successfully.
Jul 02 04:45:03 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.702s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:03 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-54d64e96-50b3-4842-ab59-147c5efa93e5 tempest-GroupsTest-2029654891 None] Delete group completed successfully.
Jul 02 04:45:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b525af79-7c03-4581-b05d-30394fbce678 tempest-GroupsTest-2029654891 None] Group tempest-GroupsTest-Group-545792335: creating
Jul 02 04:45:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b525af79-7c03-4581-b05d-30394fbce678 tempest-GroupsTest-2029654891 None] Group tempest-GroupsTest-Group-545792335: created successfully
Jul 02 04:45:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b525af79-7c03-4581-b05d-30394fbce678 tempest-GroupsTest-2029654891 None] Create group completed successfully.
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (6831d2af-0792-4cfb-b541-bd4070ce8e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc94c1ab-d6ad-46e3-a5cc-8594f96cd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc94c1ab-d6ad-46e3-a5cc-8594f96cd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160334384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e291193b-612c-4961-a04b-96065eff605a,host='devstack@QuobyteHD#QuobyteHD',id=c3782abf-4179-459b-906c-68a8aac264fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:06Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(098fdc3d-f61e-4958-af32-2d8967937f73),volume_type_id=098fdc3d-f61e-4958-af32-2d8967937f73)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19f324-9e01-44d8-9b61-0b0798b7e19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19f324-9e01-44d8-9b61-0b0798b7e19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834efee3-9593-48ba-a293-c3f259ff3d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834efee3-9593-48ba-a293-c3f259ff3d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3782abf-4179-459b-906c-68a8aac264fd', 'volume_name': 'volume-c3782abf-4179-459b-906c-68a8aac264fd', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ab59b4-22ca-4349-9612-ca9ef694690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ab59b4-22ca-4349-9612-ca9ef694690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d864a6-7cd6-47e6-bff2-72c31ab1155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:06 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Volume c3782abf-4179-459b-906c-68a8aac264fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3782abf-4179-459b-906c-68a8aac264fd', 'volume_size': 1}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e291193b-612c-4961-a04b-96065eff605a,created_at=2026-07-02T02:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160334384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e291193b-612c-4961-a04b-96065eff605a,host='devstack@QuobyteHD#QuobyteHD',id=c3782abf-4179-459b-906c-68a8aac264fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:06Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(098fdc3d-f61e-4958-af32-2d8967937f73),volume_type_id=098fdc3d-f61e-4958-af32-2d8967937f73)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Creating volume c3782abf-4179-459b-906c-68a8aac264fd {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:06 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:06 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd 1073741824
Jul 02 04:45:06 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:07 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd 1073741824" returned: 0 in 1.000s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:07 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd
Jul 02 04:45:07 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:08 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd" returned: 0 in 0.804s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d864a6-7cd6-47e6-bff2-72c31ab1155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3782abf-4179-459b-906c-68a8aac264fd', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfc0f10-d5a2-4f02-815d-4a50e0d105df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Volume volume-c3782abf-4179-459b-906c-68a8aac264fd (c3782abf-4179-459b-906c-68a8aac264fd): created successfully
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfc0f10-d5a2-4f02-815d-4a50e0d105df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (6831d2af-0792-4cfb-b541-bd4070ce8e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-18aa8cc6-7a5d-4051-a6ad-5c87bbc511b1 tempest-GroupsTest-2029654891 None] Created volume successfully.
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (37cb06d1-fb18-42b1-a02a-095f55d5b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fdbf68-d94b-4e5a-97f2-3eb610d516fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fdbf68-d94b-4e5a-97f2-3eb610d516fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887689710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e291193b-612c-4961-a04b-96065eff605a,host='devstack@QuobyteHD#QuobyteHD',id=4ca82dff-cfbe-4c3e-aef0-afcfd70798e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:09Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(098fdc3d-f61e-4958-af32-2d8967937f73),volume_type_id=098fdc3d-f61e-4958-af32-2d8967937f73)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a94f00-7e42-4270-8d5d-25177fe0171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a94f00-7e42-4270-8d5d-25177fe0171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dd6f3d-77b3-44e7-bb5f-e643d650500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dd6f3d-77b3-44e7-bb5f-e643d650500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca82dff-cfbe-4c3e-aef0-afcfd70798e3', 'volume_name': 'volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362aaba5-cb07-431c-95ee-04802d8c8430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362aaba5-cb07-431c-95ee-04802d8c8430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7106a56-7789-408b-b35e-26e79b9ae62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:09 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Volume 4ca82dff-cfbe-4c3e-aef0-afcfd70798e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3', 'volume_size': 1}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e291193b-612c-4961-a04b-96065eff605a,created_at=2026-07-02T02:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887689710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e291193b-612c-4961-a04b-96065eff605a,host='devstack@QuobyteHD#QuobyteHD',id=4ca82dff-cfbe-4c3e-aef0-afcfd70798e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec51031b7a6c4499ab2d676dbc389ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:09Z,use_quota=True,user_id='49e9f9790ccd4773bc601ece38ddc4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(098fdc3d-f61e-4958-af32-2d8967937f73),volume_type_id=098fdc3d-f61e-4958-af32-2d8967937f73)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Creating volume 4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:09 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:09 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 1073741824
Jul 02 04:45:09 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:10 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 1073741824" returned: 0 in 1.179s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:10 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3
Jul 02 04:45:10 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Flow 'volume_create_manager' (d9223190-77bb-4aad-9c21-e76bd386b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d0155b-29e3-42c4-bc7d-9a4d9d7d03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d0155b-29e3-42c4-bc7d-9a4d9d7d03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-141119570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dc5aa0-0d8a-41b2-b68f-ac84833b195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a4d889a2fb45f7b6a30a34fb583c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:11Z,use_quota=True,user_id='64fe541bc97b49cf8006107c28475bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a70115b-fc0b-498b-b13c-8dbb20446884),volume_type_id=3a70115b-fc0b-498b-b13c-8dbb20446884)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fd898-72e2-4004-98c9-95af2d4cf9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fd898-72e2-4004-98c9-95af2d4cf9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ad5789-8b48-4264-b842-ca4bef7cb1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ad5789-8b48-4264-b842-ca4bef7cb1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1dc5aa0-0d8a-41b2-b68f-ac84833b195c', 'volume_name': 'volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0501b3b-000c-4530-8fc4-3ed9230692fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0501b3b-000c-4530-8fc4-3ed9230692fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe828c2-4528-46be-99e7-f5fc62c3d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Volume a1dc5aa0-0d8a-41b2-b68f-ac84833b195c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c', 'volume_size': 1}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:11 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" returned: 0 in 0.811s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-141119570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dc5aa0-0d8a-41b2-b68f-ac84833b195c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a4d889a2fb45f7b6a30a34fb583c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:11Z,use_quota=True,user_id='64fe541bc97b49cf8006107c28475bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a70115b-fc0b-498b-b13c-8dbb20446884),volume_type_id=3a70115b-fc0b-498b-b13c-8dbb20446884)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Creating volume a1dc5aa0-0d8a-41b2-b68f-ac84833b195c {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:11 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:11 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c 1073741824
Jul 02 04:45:11 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7106a56-7789-408b-b35e-26e79b9ae62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14ce2e3-2e56-4257-8769-7c0dd27595cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Volume volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 (4ca82dff-cfbe-4c3e-aef0-afcfd70798e3): created successfully
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14ce2e3-2e56-4257-8769-7c0dd27595cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Flow 'volume_create_manager' (37cb06d1-fb18-42b1-a02a-095f55d5b697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-fd3f80d1-0b7d-4eee-b661-6338cd42bd8e tempest-GroupsTest-2029654891 None] Created volume successfully.
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-9ea664f2-e288-4ef9-bace-6addd384a458 req-01b8738c-56d4-4293-ad86-7904db3a8602 tempest-AttachVolumeShelveTestJSON-1744985770 None] No connector for attachment e437b1a6-eea3-41ba-968e-bc446c0293d6; skipping storage backend terminate_connection call. {{(pid=86158) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 02 04:45:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-9ea664f2-e288-4ef9-bace-6addd384a458 req-01b8738c-56d4-4293-ad86-7904db3a8602 tempest-AttachVolumeShelveTestJSON-1744985770 None] Deleting attachment e437b1a6-eea3-41ba-968e-bc446c0293d6. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:45:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5d13e4a0-8cd2-47ec-b6d9-ff56a580ef66 tempest-GroupsTest-2029654891 None] Update group completed successfully.
Jul 02 04:45:12 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c 1073741824" returned: 0 in 1.001s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:12 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c
Jul 02 04:45:12 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:13 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" returned: 0 in 0.990s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe828c2-4528-46be-99e7-f5fc62c3d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6f78c6-cb14-4502-b635-1e08fdd7afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:13 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Volume volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c (a1dc5aa0-0d8a-41b2-b68f-ac84833b195c): created successfully
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6f78c6-cb14-4502-b635-1e08fdd7afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Flow 'volume_create_manager' (d9223190-77bb-4aad-9c21-e76bd386b11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-77d64868-5e3a-4326-a862-f4e80fd6b9db tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Created volume successfully.
Jul 02 04:45:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-00e8b65d-a44a-4bca-83ce-49a9f1a11dca tempest-GroupsTest-2029654891 None] Update group completed successfully.
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:14 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:14 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:15 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.706s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d00725b3-3780-46d7-8b6a-52635ca36255 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Retype volume completed successfully.
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Acquiring lock "cinder-quobyte-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6024a61-aa35-4e0f-bd90-bd6000b5c7f6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:15 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3
Jul 02 04:45:15 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "cinder-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "cinder-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "cinder-quobyte-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "cinder-quobyte-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad35ffb-d70b-40e8-82f5-9c35a68fb367]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:16 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c
Jul 02 04:45:16 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:16 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" returned: 0 in 0.849s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:16 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3
Jul 02 04:45:16 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:16 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" returned: 0 in 0.890s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:17 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c
Jul 02 04:45:17 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:17 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" returned: 0 in 0.885s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-4ca82dff-cfbe-4c3e-aef0-afcfd70798e3" released by "delete_volume" :: held 1.787s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Acquiring lock "cinder-quobyte-c3782abf-4179-459b-906c-68a8aac264fd" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-c3782abf-4179-459b-906c-68a8aac264fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f86f8b-8f15-4798-a104-476d09eb13f9]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:17 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd
Jul 02 04:45:17 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:17 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" returned: 0 in 0.823s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "cinder-quobyte-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c" released by "delete_volume" :: held 1.775s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:17 devstack cinder-volume[86158]: WARNING cinder.quota [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:17 devstack cinder-volume[86158]: WARNING cinder.quota [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Created reservations ['b44749e8-ec99-4a9a-a539-31912a0adf51', '9d1a0745-8237-4dc6-88e6-0b2c01112485', 'e56687c5-2f20-490a-bdb8-e4980c421e22', '9f93a612-1b37-4cbb-a0e4-52cf8593915b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:17 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:17 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:18 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd" returned: 0 in 1.058s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:18 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd
Jul 02 04:45:18 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:19 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.108s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Deleted volume successfully.
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7dc69ee7-6be9-4aae-a7a3-bcf92c8038e4 tempest-VolumeRetypeWithoutMigrationTest-1277947382 None] Lock "cinder-a1dc5aa0-0d8a-41b2-b68f-ac84833b195c-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:19 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c3782abf-4179-459b-906c-68a8aac264fd" returned: 0 in 0.842s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "cinder-quobyte-c3782abf-4179-459b-906c-68a8aac264fd" released by "delete_volume" :: held 1.955s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Created reservations ['327c153c-4f4a-44a0-8da7-cf17b70dcd2e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:19 devstack cinder-volume[86158]: WARNING cinder.quota [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1203011053 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1203011053, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:19 devstack cinder-volume[86158]: WARNING cinder.quota [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1203011053 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1203011053, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Created reservations ['8d8f5fb2-bcd2-4494-836e-75d0af3dc1cd', 'd8d5e220-a239-49aa-84f6-996779e9becf', '15bf066d-0d0d-4d7a-a895-a993fa669bde', '72bb1bdd-b803-4dce-8177-0bd351488e02'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Created reservations ['2648de93-7258-4ad2-a1af-8354f48036b5', '549c94f6-b619-476a-b7bd-f02c3e8db7bd', '5753bf5c-9fe6-4481-9427-8caa043b7db8', '9f001ef6-dd37-435f-98d8-741dc18e7fc2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:19 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:19 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.748s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:20 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:20 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:20 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-658299bb-f264-4f63-8d98-34d4c8915881 tempest-GroupsTest-2029654891 None] Delete group completed successfully.
Jul 02 04:45:29 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=115,cinder:INSERT=26,cinder:UPDATE=129,cinder:DELETE=6 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:45:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-993fb426-9365-4e5d-8aa6-9cdbcd81631f tempest-GroupsV314Test-1143458871 None] Group tempest-GroupsV314Test-Group-1093767331: creating
Jul 02 04:45:29 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=104,cinder:INSERT=31,cinder:UPDATE=131,cinder:DELETE=7 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:45:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-993fb426-9365-4e5d-8aa6-9cdbcd81631f tempest-GroupsV314Test-1143458871 None] Group tempest-GroupsV314Test-Group-1093767331: created successfully
Jul 02 04:45:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-993fb426-9365-4e5d-8aa6-9cdbcd81631f tempest-GroupsV314Test-1143458871 None] Create group completed successfully.
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Flow 'volume_create_manager' (f5a871ec-1372-4deb-b6e7-47b9eeb70f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a02c592-40f4-4c0d-9a8d-5092c88eeaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a02c592-40f4-4c0d-9a8d-5092c88eeaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406892478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbb7f143-2746-4fcf-b07c-203cddc0238f,host='devstack@QuobyteHD#QuobyteHD',id=6839c912-6886-4e2a-8502-ee88e13d83dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccbf4b1d6b246b3be3058eff11cdfd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:31Z,use_quota=True,user_id='7f28e3fd9d5e44bb812fe51ff1142084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98fead1e-8a52-4cba-87e4-b784bf63024d),volume_type_id=98fead1e-8a52-4cba-87e4-b784bf63024d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4927cf-5e53-499f-b325-17f3f178273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4927cf-5e53-499f-b325-17f3f178273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e0d50e-d13e-4965-a68e-1a855a9aa32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e0d50e-d13e-4965-a68e-1a855a9aa32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6839c912-6886-4e2a-8502-ee88e13d83dc', 'volume_name': 'volume-6839c912-6886-4e2a-8502-ee88e13d83dc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb30be-2a20-4308-8f57-f43f77909332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb30be-2a20-4308-8f57-f43f77909332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3424e878-d636-43b5-a8f0-c26407a1da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Volume 6839c912-6886-4e2a-8502-ee88e13d83dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6839c912-6886-4e2a-8502-ee88e13d83dc', 'volume_size': 1}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bbb7f143-2746-4fcf-b07c-203cddc0238f,created_at=2026-07-02T02:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-406892478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bbb7f143-2746-4fcf-b07c-203cddc0238f,host='devstack@QuobyteHD#QuobyteHD',id=6839c912-6886-4e2a-8502-ee88e13d83dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccbf4b1d6b246b3be3058eff11cdfd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:31Z,use_quota=True,user_id='7f28e3fd9d5e44bb812fe51ff1142084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98fead1e-8a52-4cba-87e4-b784bf63024d),volume_type_id=98fead1e-8a52-4cba-87e4-b784bf63024d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Creating volume 6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:31 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:31 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc 1073741824
Jul 02 04:45:31 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Flow 'volume_create_manager' (0e6e8be0-0ab4-438e-8c1b-a96e7bd9873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603e882-6040-4cc7-9473-7e6f41b42c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d603e882-6040-4cc7-9473-7e6f41b42c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-112335817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a4614-7a6e-4e2a-b272-ecbdbf090e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6fe6204a504e868b37d047d7d380fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:32Z,use_quota=True,user_id='ea3ad0f71adc4189a16b62da4cb61f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0a8c96-4599-4636-825c-b362b0722c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0a8c96-4599-4636-825c-b362b0722c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e2a0a8-3d5e-4bce-8052-94bebcdeca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e2a0a8-3d5e-4bce-8052-94bebcdeca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365a4614-7a6e-4e2a-b272-ecbdbf090e91', 'volume_name': 'volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae02a95-3950-4bf2-add1-1b26a8149e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae02a95-3950-4bf2-add1-1b26a8149e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b4290-81b4-4b93-9cee-fafb88ae28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Volume 365a4614-7a6e-4e2a-b272-ecbdbf090e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91', 'volume_size': 1}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:32 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc 1073741824" returned: 0 in 0.954s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:32 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:45:32 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:33 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 0.668s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-112335817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365a4614-7a6e-4e2a-b272-ecbdbf090e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6fe6204a504e868b37d047d7d380fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:32Z,use_quota=True,user_id='ea3ad0f71adc4189a16b62da4cb61f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Creating volume 365a4614-7a6e-4e2a-b272-ecbdbf090e91 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:33 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3424e878-d636-43b5-a8f0-c26407a1da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6839c912-6886-4e2a-8502-ee88e13d83dc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55a4e3b-308b-4c72-b08f-858cbef7b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:33 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 1073741824
Jul 02 04:45:33 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Volume volume-6839c912-6886-4e2a-8502-ee88e13d83dc (6839c912-6886-4e2a-8502-ee88e13d83dc): created successfully
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55a4e3b-308b-4c72-b08f-858cbef7b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Flow 'volume_create_manager' (f5a871ec-1372-4deb-b6e7-47b9eeb70f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d64a7d57-1e4d-4f03-8bc6-7ed67be3e34e tempest-GroupsV314Test-1143458871 None] Created volume successfully.
Jul 02 04:45:34 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 1073741824" returned: 0 in 1.063s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:34 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91
Jul 02 04:45:34 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:35 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91" returned: 0 in 0.882s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.240s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:35 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Cloning volume 6839c912-6886-4e2a-8502-ee88e13d83dc to volume 51b6be1f-f236-4b3d-960a-e165f54c50cc
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776b4290-81b4-4b93-9cee-fafb88ae28fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158e7fa-4da7-48dd-a2f9-054391b21729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Creating offline snapshot d30a03d1-c4b3-4525-af8a-8d68634062be of volume 6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:45:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Volume volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 (365a4614-7a6e-4e2a-b272-ecbdbf090e91): created successfully
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158e7fa-4da7-48dd-a2f9-054391b21729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Flow 'volume_create_manager' (0e6e8be0-0ab4-438e-8c1b-a96e7bd9873c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef19302-124a-4f36-88fc-1b842ded8396]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1c323d6c-7ac4-48d4-a7db-9b8af4bddc2d tempest-TaggedAttachmentsTest-711018766 None] Created volume successfully.
Jul 02 04:45:35 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:45:35 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:36 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 0.854s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:36 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be 1G
Jul 02 04:45:36 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (b28f25fb-0c65-47ac-859f-a3314d86ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47299e83-e4bd-4460-849b-489de0ff7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47299e83-e4bd-4460-849b-489de0ff7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-119646304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36846a96-6519-4ded-9d16-74754361a31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1947ff1e3472b9e7e756dfd7334b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:37Z,use_quota=True,user_id='53356a1dcb2541bc9d9a71d3bc914247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d42fbfc-60fc-42ce-bbee-66bc5ce19dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d42fbfc-60fc-42ce-bbee-66bc5ce19dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c814620-9487-454c-bab0-1d8b65b04157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c814620-9487-454c-bab0-1d8b65b04157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36846a96-6519-4ded-9d16-74754361a31f', 'volume_name': 'volume-36846a96-6519-4ded-9d16-74754361a31f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a569727c-040a-4cb7-ada0-4b597f1ae9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a569727c-040a-4cb7-ada0-4b597f1ae9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b069bab-9180-40a6-b34a-f962e512abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Volume 36846a96-6519-4ded-9d16-74754361a31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36846a96-6519-4ded-9d16-74754361a31f', 'volume_size': 1}
Jul 02 04:45:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:37 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be 1G" returned: 0 in 1.017s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6839c912-6886-4e2a-8502-ee88e13d83dc -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:37 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6839c912-6886-4e2a-8502-ee88e13d83dc -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:37 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:38 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6839c912-6886-4e2a-8502-ee88e13d83dc -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 1.270s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:38 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:45:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:38 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:38 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:39 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 1.066s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:39 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info
Jul 02 04:45:39 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:40 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info" returned: 0 in 0.945s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:40 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:45:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:40 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info
Jul 02 04:45:40 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:41 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.info" returned: 0 in 0.825s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Acquiring lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] snapshot: d30a03d1-c4b3-4525-af8a-8d68634062be, volume: 51b6be1f-f236-4b3d-960a-e165f54c50cc,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e43c01-307a-4d52-8f1c-c353f2bc6f65]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:41 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:41 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:42 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 0.795s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6839c912-6886-4e2a-8502-ee88e13d83dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b6bdf-55fa-439a-9bd4-3935c5bda797]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:42 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:45:42 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:43 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 0.782s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:43 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:45:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:43 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc
Jul 02 04:45:43 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:49 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=7,cinder:SELECT=12,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:45:49 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:45:50 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc" returned: 0 in 7.237s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1b5e0e-1a60-44fc-a65e-0c6d53fd445e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:50 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:45:50 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:51 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 1.032s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:45:51 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Converted 1024.00 MB image at 141.48 MB/s
Jul 02 04:45:51 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:51 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc
Jul 02 04:45:51 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:51 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:51 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:52 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc" returned: 0 in 0.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" released by "_copy_volume_from_snapshot" :: held 10.670s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Acquiring lock "cinder-quobyte-d30a03d1-c4b3-4525-af8a-8d68634062be" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-d30a03d1-c4b3-4525-af8a-8d68634062be" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Deleting offline snapshot d30a03d1-c4b3-4525-af8a-8d68634062be of volume 6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] snapshot_file for this snap is: volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[61548d63-d55e-403b-92eb-2fc4123367c0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:52 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:52 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:52 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.857s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 8 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:45:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:45:52 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 0.792s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6839c912-6886-4e2a-8502-ee88e13d83dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d2a003-1bea-4867-9173-25c9e328ceba]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:53 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:45:53 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:53 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 0.760s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:53 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:53 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:54 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 0.792s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:54 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be
Jul 02 04:45:54 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:55 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc.d30a03d1-c4b3-4525-af8a-8d68634062be" returned: 0 in 0.636s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-d30a03d1-c4b3-4525-af8a-8d68634062be" released by "_delete_snapshot" :: held 3.069s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.550s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-119646304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36846a96-6519-4ded-9d16-74754361a31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1947ff1e3472b9e7e756dfd7334b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:45:37Z,use_quota=True,user_id='53356a1dcb2541bc9d9a71d3bc914247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Creating volume 36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:45:55 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:45:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:55 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f 1073741824
Jul 02 04:45:55 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6735f4e5-b6cd-4dad-a039-c80b051b2532 tempest-GroupsV314Test-1143458871 None] Create group from source-group-bbb7f143-2746-4fcf-b07c-203cddc0238f completed successfully.
Jul 02 04:45:56 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f 1073741824" returned: 0 in 0.866s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Acquiring lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:45:56 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f
Jul 02 04:45:56 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5101d8-a8f8-45e5-89a9-03614ff8b10b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:56 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc
Jul 02 04:45:56 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:56 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f" returned: 0 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b069bab-9180-40a6-b34a-f962e512abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36846a96-6519-4ded-9d16-74754361a31f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44edb5ab-ec23-4ecd-82ff-dab8910ec32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:45:57 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Volume volume-36846a96-6519-4ded-9d16-74754361a31f (36846a96-6519-4ded-9d16-74754361a31f): created successfully
Jul 02 04:45:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44edb5ab-ec23-4ecd-82ff-dab8910ec32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:45:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (b28f25fb-0c65-47ac-859f-a3314d86ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:45:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-57e6e67c-014e-4e91-82fc-9fedfc70718f tempest-VolumesDeleteCascade-2086213514 None] Created volume successfully.
Jul 02 04:45:57 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc" returned: 0 in 1.007s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:57 devstack sudo[89642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc
Jul 02 04:45:57 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Creating offline snapshot a598921b-31c4-472a-8d64-2d7e5f6e7a69 of volume 36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959272a-8cde-404b-8755-1679ea3a3d9d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:58 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f
Jul 02 04:45:58 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:58 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51b6be1f-f236-4b3d-960a-e165f54c50cc" returned: 0 in 1.200s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-51b6be1f-f236-4b3d-960a-e165f54c50cc" released by "delete_volume" :: held 2.278s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Created reservations ['52deff4c-7a5c-4bdf-8939-2f4bdff5d4f1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:58 devstack cinder-volume[86158]: WARNING cinder.quota [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1386806147 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1386806147, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:58 devstack cinder-volume[86158]: WARNING cinder.quota [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1386806147 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1386806147, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:45:58 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Created reservations ['42c7a332-7a69-4744-ab94-5f3b91b6faa8', 'bc9579db-db7b-41ca-ac9b-c7c0c0beb379', '2d9bf583-6a3a-4621-ac4b-0ccdb2c793e7', 'dabe37d8-e46b-4d37-ada6-585d5fb199dd'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:59 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:45:59 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:59 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f" returned: 0 in 1.286s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:45:59 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 1G
Jul 02 04:45:59 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:45:59 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.821s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:45:59 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:45:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-858fd129-c8bf-46c0-90a7-c7d9a44320d4 tempest-GroupsV314Test-1143458871 None] Delete group completed successfully.
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Acquiring lock "cinder-quobyte-6839c912-6886-4e2a-8502-ee88e13d83dc" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:00 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 1G" returned: 0 in 1.087s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-6839c912-6886-4e2a-8502-ee88e13d83dc" acquired by "delete_volume" :: waited 0.046s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:00 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:00 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9225a-9ab8-4718-9e54-0ac25a9f36ce]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:00 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:46:00 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:01 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 1.149s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:01 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:01 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 is being set with open permissions: ugo+rw
Jul 02 04:46:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 1.067s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:01 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:01 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:01 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc
Jul 02 04:46:01 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:02 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6839c912-6886-4e2a-8502-ee88e13d83dc" returned: 0 in 1.093s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:02 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 1.158s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Lock "cinder-quobyte-6839c912-6886-4e2a-8502-ee88e13d83dc" released by "delete_volume" :: held 2.295s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:03 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info
Jul 02 04:46:03 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Created reservations ['6a98f512-2a8f-4457-aa20-f058b9654b09'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Created reservations ['04cf26f8-5f06-4c8a-bd59-f39fb43405d6', 'eca06a70-ab1a-4ba6-bd3c-20ee9938efd9', '3b5c10da-a1dc-481f-92f5-e91441651da7', '9f7c0430-5011-429f-8b52-51cd941f001f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:03 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:03 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:04 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info" returned: 0 in 1.188s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:04 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info is being set with open permissions: ugo+rw
Jul 02 04:46:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:04 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info
Jul 02 04:46:04 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:04 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.520s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:04 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-234cc471-f32f-4770-ae1e-b6acbd960898 tempest-GroupsV314Test-1143458871 None] Delete group completed successfully.
Jul 02 04:46:05 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.info" returned: 0 in 1.110s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.152s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:05 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-275bc558-9697-47e1-8651-24678dad1a93 tempest-VolumesDeleteCascade-2086213514 None] Create snapshot completed successfully
Jul 02 04:46:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Creating offline snapshot 41808b65-6400-423a-b46d-1c147251faf1 of volume 36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:46:06 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb57e2-892d-482c-9cda-4b92ddb3744b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:06 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:06 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:07 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 0.950s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36846a96-6519-4ded-9d16-74754361a31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:07 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 1G
Jul 02 04:46:07 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:08 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 1G" returned: 0 in 0.927s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:08 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1
Jul 02 04:46:08 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:08 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1" returned: 0 in 0.780s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:08 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 is being set with open permissions: ugo+rw
Jul 02 04:46:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:08 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1
Jul 02 04:46:08 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:09 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1" returned: 0 in 0.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.517s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0546bb62-95f7-47c6-86c8-09af4d189428 tempest-VolumesDeleteCascade-2086213514 None] Create snapshot completed successfully
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-36846a96-6519-4ded-9d16-74754361a31f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-36846a96-6519-4ded-9d16-74754361a31f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Performing cascade delete. {{(pid=86158) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 02 04:46:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9b7b6c54-a8ba-419d-ab3a-ea291ae0e6ed tempest-GroupsV320Test-1529123065 None] Group tempest-GroupsV320Test-Group-1371284581: creating
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-41808b65-6400-423a-b46d-1c147251faf1-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-41808b65-6400-423a-b46d-1c147251faf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9b7b6c54-a8ba-419d-ab3a-ea291ae0e6ed tempest-GroupsV320Test-1529123065 None] Group tempest-GroupsV320Test-Group-1371284581: created successfully
Jul 02 04:46:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9b7b6c54-a8ba-419d-ab3a-ea291ae0e6ed tempest-GroupsV320Test-1529123065 None] Create group completed successfully.
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-41808b65-6400-423a-b46d-1c147251faf1" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-41808b65-6400-423a-b46d-1c147251faf1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Deleting offline snapshot 41808b65-6400-423a-b46d-1c147251faf1 of volume 36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] snapshot_file for this snap is: volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Acquiring lock "cinder-2d6e80bb-9940-4fdf-8ded-a30b045d8701-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[790635a7-efb3-4ab7-8ef5-7c9660f31164]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "cinder-2d6e80bb-9940-4fdf-8ded-a30b045d8701-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Acquiring lock "cinder-quobyte-2d6e80bb-9940-4fdf-8ded-a30b045d8701" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "cinder-quobyte-2d6e80bb-9940-4fdf-8ded-a30b045d8701" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c066a4-1f6f-49b2-9eed-e842a837ee2b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:10 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1
Jul 02 04:46:10 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:10 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701
Jul 02 04:46:10 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:11 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1" returned: 0 in 0.882s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36846a96-6519-4ded-9d16-74754361a31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1927e5f-4a93-41b0-8944-05dab5d28597]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:11 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701" returned: 0 in 0.852s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:11 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701
Jul 02 04:46:11 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:11 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:11 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Created reservations ['cc479f7d-c436-40de-b3aa-24bb1dd863bc'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:12 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:12 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:12 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d6e80bb-9940-4fdf-8ded-a30b045d8701" returned: 0 in 0.754s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "cinder-quobyte-2d6e80bb-9940-4fdf-8ded-a30b045d8701" released by "delete_volume" :: held 1.656s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Created reservations ['9c9f9115-50cf-4754-935b-75c1f2a56e2d', 'a81ffabb-b3df-4f07-b183-66eb8a1463e0', '7623a769-68eb-4abc-a1a7-957db8620998', '52aeb07b-8e5c-4d44-bddc-7169d2f19fab'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:12 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 0.891s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36846a96-6519-4ded-9d16-74754361a31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:12 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1
Jul 02 04:46:12 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:12 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:12 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:13 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.662s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-442b7836-04ae-4a5a-a62d-3ebafc2471fa tempest-GroupsV320Test-1529123065 None] Delete group completed successfully.
Jul 02 04:46:13 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.688s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Deleted volume successfully.
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8aac5b58-ca0f-42af-bee7-72f411daa6ef tempest-AttachVolumeShelveTestJSON-1744985770 None] Lock "cinder-2d6e80bb-9940-4fdf-8ded-a30b045d8701-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:13 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1" returned: 0 in 0.911s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:13 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1
Jul 02 04:46:13 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:14 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.41808b65-6400-423a-b46d-1c147251faf1" returned: 0 in 0.717s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-41808b65-6400-423a-b46d-1c147251faf1" released by "_delete_snapshot" :: held 3.530s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" released by "delete_snapshot" :: held 3.556s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['2d11e865-d563-4673-8fed-1dd52c9b96f2', '443e11a5-8975-4585-aee0-fd783628e104', '35d330f9-ecbd-43d2-a603-013a24e4e6a1', 'e8505183-751f-4fdf-a993-be0645ffb952'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:14 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Delete snapshot completed successfully.
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-41808b65-6400-423a-b46d-1c147251faf1-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-a598921b-31c4-472a-8d64-2d7e5f6e7a69-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-a598921b-31c4-472a-8d64-2d7e5f6e7a69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-a598921b-31c4-472a-8d64-2d7e5f6e7a69" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-a598921b-31c4-472a-8d64-2d7e5f6e7a69" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Deleting offline snapshot a598921b-31c4-472a-8d64-2d7e5f6e7a69 of volume 36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] snapshot_file for this snap is: volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca3045-ec0a-405d-abd6-1732ce09afb3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:14 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:14 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:15 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 0.920s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36846a96-6519-4ded-9d16-74754361a31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4683d468-217d-4056-ac76-dbe599519cbd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:15 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f
Jul 02 04:46:15 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:16 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f" returned: 0 in 0.957s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:16 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:16 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:17 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 0.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:17 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69
Jul 02 04:46:17 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:18 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f.a598921b-31c4-472a-8d64-2d7e5f6e7a69" returned: 0 in 0.773s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-a598921b-31c4-472a-8d64-2d7e5f6e7a69" released by "_delete_snapshot" :: held 3.671s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" released by "delete_snapshot" :: held 3.715s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['7fd6b448-ec33-4dbb-840a-08b1eb296390', 'a4be2abf-eab5-47e4-8913-6c8e01e506a7', '2a95ea01-ee4f-4431-b93a-041dbd3c82f4', 'd6f2bb1d-ba38-4f44-bf00-3d0445e60eb4'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Delete snapshot completed successfully.
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-a598921b-31c4-472a-8d64-2d7e5f6e7a69-delete_snapshot" released by "delete_snapshot" :: held 3.926s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Snapshots deleted, issuing volume delete {{(pid=86158) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[109e0317-b730-4f0f-a878-52713cbbaae1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:18 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f
Jul 02 04:46:18 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:19 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f" returned: 0 in 0.878s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:19 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f
Jul 02 04:46:19 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:20 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36846a96-6519-4ded-9d16-74754361a31f" returned: 0 in 0.722s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-36846a96-6519-4ded-9d16-74754361a31f" released by "delete_volume" :: held 1.699s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['2b7663bc-1bb7-47da-b1a8-e1700f5aaed4', 'a9157975-8003-4375-ac6b-51291873be83', 'd84dd074-b5f9-4da0-8ea7-cbe35ef4f3b2', '56c9ee5b-dda1-43e0-aa96-eee44da2fa3a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:20 devstack sudo[89857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:20 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:21 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.897s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Deleted volume successfully.
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5105d103-090f-4d4e-9cab-ce7c6818c614 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-36846a96-6519-4ded-9d16-74754361a31f-delete_volume" released by "delete_volume" :: held 10.710s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (e2788668-59ab-4811-ad55-9362b2c199ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cfa404-f9f3-43b4-9dcd-3f8d713b77ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cfa404-f9f3-43b4-9dcd-3f8d713b77ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2018093846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1947ff1e3472b9e7e756dfd7334b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:46:21Z,use_quota=True,user_id='53356a1dcb2541bc9d9a71d3bc914247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81ab211-5f7f-40e4-ae17-e52c738850fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81ab211-5f7f-40e4-ae17-e52c738850fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762f2759-f5e5-4080-83e1-ccaec1b450d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762f2759-f5e5-4080-83e1-ccaec1b450d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c', 'volume_name': 'volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d70d9-f974-4d5a-bc26-a583d6aa08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d70d9-f974-4d5a-bc26-a583d6aa08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e984ebe0-b373-4d95-8d7f-78aab16c1712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Volume 3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c', 'volume_size': 1}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2018093846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1947ff1e3472b9e7e756dfd7334b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:46:21Z,use_quota=True,user_id='53356a1dcb2541bc9d9a71d3bc914247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Creating volume 3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:46:21 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:46:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:21 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c 1073741824
Jul 02 04:46:21 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c 1073741824" returned: 0 in 1.053s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:22 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:22 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:22 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:23 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 0.805s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e984ebe0-b373-4d95-8d7f-78aab16c1712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4376e6-281b-4e20-a4cf-f3c4b276e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Volume volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c (3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c): created successfully
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4376e6-281b-4e20-a4cf-f3c4b276e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (e2788668-59ab-4811-ad55-9362b2c199ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bfa752f3-39f4-4ede-95e7-313486552c9a tempest-VolumesDeleteCascade-2086213514 None] Created volume successfully.
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Creating offline snapshot 7a289845-7206-4488-a705-be6615b5251f of volume 3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447cd46-d4a8-42d5-85b7-7410352ededd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:24 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:24 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:24 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 0.926s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:24 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f 1G
Jul 02 04:46:24 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:25 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f 1G" returned: 0 in 1.141s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:25 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:25 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:26 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 0.783s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:26 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f is being set with open permissions: ugo+rw
Jul 02 04:46:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:26 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:26 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:27 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 0.912s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:27 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info
Jul 02 04:46:27 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:28 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info" returned: 0 in 0.804s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:28 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info is being set with open permissions: ugo+rw
Jul 02 04:46:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:28 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info
Jul 02 04:46:28 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:29 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.info" returned: 0 in 0.932s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.615s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ac086400-dbd0-400a-8810-8c9c92a51e9c tempest-VolumesDeleteCascade-2086213514 None] Create snapshot completed successfully
Jul 02 04:46:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (06dc2982-be02-4a9c-879c-46fcdfb0b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91255856-1f2d-4a8f-9f99-b846d8bcc2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91255856-1f2d-4a8f-9f99-b846d8bcc2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1438405632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5892389b-e5ff-4a2f-bd46-481f3c2f4db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a1947ff1e3472b9e7e756dfd7334b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a289845-7206-4488-a705-be6615b5251f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:46:31Z,use_quota=True,user_id='53356a1dcb2541bc9d9a71d3bc914247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ccc92-82f6-4b91-84b6-7519925acebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ccc92-82f6-4b91-84b6-7519925acebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8d832a-eb7c-4502-ab9b-ebb086db1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8d832a-eb7c-4502-ab9b-ebb086db1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5892389b-e5ff-4a2f-bd46-481f3c2f4db8', 'volume_name': 'volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8', 'volume_size': 1, 'snapshot_id': '7a289845-7206-4488-a705-be6615b5251f'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1253b7f-be82-4843-8b62-513213802790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1253b7f-be82-4843-8b62-513213802790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ca79d9-9d11-4d20-b0db-519a2fd81a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Volume 5892389b-e5ff-4a2f-bd46-481f3c2f4db8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8', 'volume_size': 1, 'snapshot_id': '7a289845-7206-4488-a705-be6615b5251f'}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Creating volume 5892389b-e5ff-4a2f-bd46-481f3c2f4db8 from snapshot 7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] snapshot: 7a289845-7206-4488-a705-be6615b5251f, volume: 5892389b-e5ff-4a2f-bd46-481f3c2f4db8,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb22609-b079-425b-8a7b-00e353079f5d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:31 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:31 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:32 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 1.115s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ef9728-4b42-4bed-8210-96e682853220]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:32 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:32 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:33 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 0.850s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:33 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:46:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:33 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8
Jul 02 04:46:33 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" returned: 0 in 7.202s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cde0fa-5ec6-4886-b338-c2d34f9833bc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:40 devstack sudo[90037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:40 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:41 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=61,cinder:SELECT=57,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:46:41 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 1.451s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:41 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:46:41 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Converted 1024.00 MB image at 142.15 MB/s
Jul 02 04:46:41 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 is being set with open permissions: ugo+rw
Jul 02 04:46:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:41 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8
Jul 02 04:46:41 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:42 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" returned: 0 in 0.896s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" released by "_copy_volume_from_snapshot" :: held 11.653s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" released by "_create_volume_from_snapshot" :: held 11.704s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.721s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.101s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[12300095-acf3-4d1f-90fb-d4f656dc2413]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ca79d9-9d11-4d20-b0db-519a2fd81a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8', 'volume_size': 1, 'snapshot_id': '7a289845-7206-4488-a705-be6615b5251f'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cae6511-88c4-4592-b0e9-d8061143d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:42 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Volume volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 (5892389b-e5ff-4a2f-bd46-481f3c2f4db8): created successfully
Jul 02 04:46:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cae6511-88c4-4592-b0e9-d8061143d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Flow 'volume_create_manager' (06dc2982-be02-4a9c-879c-46fcdfb0b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6f2f0e1d-dc99-43c9-a6f1-5ef6560229fc tempest-VolumesDeleteCascade-2086213514 None] Created volume successfully.
Jul 02 04:46:43 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91
Jul 02 04:46:43 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Flow 'volume_create_manager' (c32f748b-f757-4cc0-b545-ee5b80f2a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9638c31-0e9b-4da8-95f2-3212b52e06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9638c31-0e9b-4da8-95f2-3212b52e06e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1904163504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256f8a05-11f9-4c11-84e3-436f6614a1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053ec99dd7e4a29a58eff0a8c86e869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:46:44Z,use_quota=True,user_id='aa7a79590ad24470bd65ce448c1e1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74265d76-c960-4474-812d-488e1de295c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74265d76-c960-4474-812d-488e1de295c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fe0fbf-2367-4b05-8871-3142348f09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fe0fbf-2367-4b05-8871-3142348f09b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256f8a05-11f9-4c11-84e3-436f6614a1be', 'volume_name': 'volume-256f8a05-11f9-4c11-84e3-436f6614a1be', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17167650-07f2-4d50-82e5-a164257cdc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17167650-07f2-4d50-82e5-a164257cdc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515c01e1-f66f-43dd-b06e-56553a055f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Volume 256f8a05-11f9-4c11-84e3-436f6614a1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256f8a05-11f9-4c11-84e3-436f6614a1be', 'volume_size': 1}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:43 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91" returned: 0 in 0.952s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1904163504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256f8a05-11f9-4c11-84e3-436f6614a1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053ec99dd7e4a29a58eff0a8c86e869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:46:44Z,use_quota=True,user_id='aa7a79590ad24470bd65ce448c1e1f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Creating volume 256f8a05-11f9-4c11-84e3-436f6614a1be {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:46:43 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:43 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be 1073741824
Jul 02 04:46:43 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1155078-b82e-4b35-b7be-8a212db88742', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Performing cascade delete. {{(pid=86158) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-7a289845-7206-4488-a705-be6615b5251f-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-7a289845-7206-4488-a705-be6615b5251f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-b28f56ca-59c8-4826-8cf2-a08bf6183cb8 req-7c8c0d5a-84b3-4882-b4cd-a0cfd9b11557 tempest-TaggedAttachmentsTest-711018766 None] attachment_update completed successfully.
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Deleting offline snapshot 7a289845-7206-4488-a705-be6615b5251f of volume 3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] snapshot_file for this snap is: volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b0bf2b-8a5c-417f-8757-55eb8a956a52]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:44 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:44 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:44 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be 1073741824" returned: 0 in 0.992s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:44 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be
Jul 02 04:46:44 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:44 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 0.866s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164fe33-72fb-4c90-8609-b960000f1e9b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:45 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:45 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:45 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be" returned: 0 in 0.695s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515c01e1-f66f-43dd-b06e-56553a055f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256f8a05-11f9-4c11-84e3-436f6614a1be', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db56705-039b-4f5f-bf5f-9b8843036d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:46:45 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Volume volume-256f8a05-11f9-4c11-84e3-436f6614a1be (256f8a05-11f9-4c11-84e3-436f6614a1be): created successfully
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db56705-039b-4f5f-bf5f-9b8843036d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Flow 'volume_create_manager' (c32f748b-f757-4cc0-b545-ee5b80f2a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:46:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-987912d4-93b1-49a4-8cf4-f504d682f4e5 tempest-VolumesMetadataTest-1179348479 None] Created volume successfully.
Jul 02 04:46:45 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 0.876s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:45 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:45 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Acquiring lock "cinder-256f8a05-11f9-4c11-84e3-436f6614a1be-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "cinder-256f8a05-11f9-4c11-84e3-436f6614a1be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:46 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 0.853s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Acquiring lock "cinder-quobyte-256f8a05-11f9-4c11-84e3-436f6614a1be" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:46 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f
Jul 02 04:46:46 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "cinder-quobyte-256f8a05-11f9-4c11-84e3-436f6614a1be" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c6918-8f1b-415c-bb6d-d60d34d04aee]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:46 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be
Jul 02 04:46:46 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:47 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c.7a289845-7206-4488-a705-be6615b5251f" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-7a289845-7206-4488-a705-be6615b5251f" released by "_delete_snapshot" :: held 3.387s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" released by "delete_snapshot" :: held 3.413s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['4c1eb677-1002-44ac-907f-59affd76dec5', '45f0f15b-8b70-4f7f-9a8c-b2dad235e6d4', '0ab537d2-a1bc-4e60-8206-ced25012473d', 'ca9f869c-fd8c-4350-a5aa-2fc2feaac420'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:47 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Delete snapshot completed successfully.
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-7a289845-7206-4488-a705-be6615b5251f-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Snapshots deleted, issuing volume delete {{(pid=86158) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:47 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be" returned: 0 in 0.839s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddb4e7a-1f19-40d6-8a69-a7c29ae1abba]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:47 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be
Jul 02 04:46:47 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:47 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:47 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:48 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-256f8a05-11f9-4c11-84e3-436f6614a1be" returned: 0 in 0.964s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "cinder-quobyte-256f8a05-11f9-4c11-84e3-436f6614a1be" released by "delete_volume" :: held 1.882s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Created reservations ['4db82b7e-cfa0-47e4-964b-8d20a8d00cf8', 'e41f7957-cbbf-47fb-811f-a1156a213e6f', 'a39809a4-87ed-436c-b296-c3dc3ebf86fc', 'e11a767f-7e9f-4fcb-8219-96daeda421b6'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:48 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 1.186s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:48 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c
Jul 02 04:46:48 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:48 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:48 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:50 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" returned: 0 in 1.196s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c" released by "delete_volume" :: held 2.477s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=88,cinder:SELECT=85,cinder:DELETE=3,cinder:INSERT=21 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['1278fe30-faeb-4932-85f1-6e2423863428', 'bfe66a05-2229-4d86-bdfe-671221752440', '1bd9fc14-7e99-417c-8b0d-9ac66817b4c4', 'd23dd660-bb05-4114-a744-c63d3be709ed'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:50 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:50 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:50 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.468s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:50 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Deleted volume successfully.
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d6523432-b092-4bb8-9622-9739ff9173dd tempest-VolumesMetadataTest-1179348479 None] Lock "cinder-256f8a05-11f9-4c11-84e3-436f6614a1be-delete_volume" released by "delete_volume" :: held 3.786s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-5892389b-e5ff-4a2f-bd46-481f3c2f4db8-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-5892389b-e5ff-4a2f-bd46-481f3c2f4db8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" acquired by "delete_volume" :: waited 0.040s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d409693-09df-4042-b744-15f0f7084744]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:51 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8
Jul 02 04:46:51 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:51 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.358s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Deleted volume successfully.
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0f98acf4-1e4f-461d-98d3-2418adc93b08 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-3a8ab5ec-c7b6-4b58-b8de-7d0c4826bc5c-delete_volume" released by "delete_volume" :: held 7.831s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:51 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:51 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-f3c6ff7e-46dd-4de8-ba73-0c0f570be4d4 req-b19b9a70-3f3d-4f5d-a18c-77c32c8e398a tempest-TaggedAttachmentsTest-711018766 None] Terminate volume connection completed successfully.
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-f3c6ff7e-46dd-4de8-ba73-0c0f570be4d4 req-b19b9a70-3f3d-4f5d-a18c-77c32c8e398a tempest-TaggedAttachmentsTest-711018766 None] Deleting attachment c1155078-b82e-4b35-b7be-8a212db88742. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:46:52 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" returned: 0 in 1.576s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:52 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 8 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:46:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:46:52 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8
Jul 02 04:46:52 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:53 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" returned: 0 in 0.891s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-quobyte-5892389b-e5ff-4a2f-bd46-481f3c2f4db8" released by "delete_volume" :: held 2.574s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Created reservations ['0f42fb55-dee0-4e85-9803-aeb0b002b7a2', '24b317ab-877e-47eb-80fd-2322b7ea6ce5', '184b317a-ff5f-412c-9b97-90fe7403e0bc', 'ec3c769b-ca6e-44b3-a9f5-b518a14298bc'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:46:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:46:53 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:46:53 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:46:55 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Jul 02 04:46:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.151s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:46:55 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:46:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Deleted volume successfully.
Jul 02 04:46:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a82f5ed6-1dca-4d1b-b00b-70a555bd1c97 tempest-VolumesDeleteCascade-2086213514 None] Lock "cinder-5892389b-e5ff-4a2f-bd46-481f3c2f4db8-delete_volume" released by "delete_volume" :: held 4.123s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Flow 'volume_create_manager' (56ab93f0-48e1-4136-baf1-7b352f6d3fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d7d863-33eb-490e-8bd1-9282e6c69876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d7d863-33eb-490e-8bd1-9282e6c69876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1708461489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaddf50-16d6-4891-98f2-214320af2f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005e1b81b0b3468d8687fba8871d9320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:01Z,use_quota=True,user_id='4b1d978dec904b8a92f3fe2eff426ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737c8873-08e8-4888-b6f5-00d947b8ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737c8873-08e8-4888-b6f5-00d947b8ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ee0b20-b960-46bf-9057-01e01d083b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:00 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 04:47:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ee0b20-b960-46bf-9057-01e01d083b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3aaddf50-16d6-4891-98f2-214320af2f19', 'volume_name': 'volume-3aaddf50-16d6-4891-98f2-214320af2f19', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ef5910>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e47cb1-8db4-4805-ae27-58800bbf45e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e47cb1-8db4-4805-ae27-58800bbf45e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cb8734-5a88-432d-a258-419859fe145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:01 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Volume 3aaddf50-16d6-4891-98f2-214320af2f19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3aaddf50-16d6-4891-98f2-214320af2f19', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ef5910>}
Jul 02 04:47:01 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Trying to clone 3aaddf50-16d6-4891-98f2-214320af2f19 from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 04:47:02 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 04:47:02 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 04:47:02 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1061350c-0341-4b4e-b9f8-70d88f3db00a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:02 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD
Jul 02 04:47:02 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:03 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD" returned: 0 in 0.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 is fetched for user 4b1d978dec904b8a92f3fe2eff426ebb. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[de772571-889d-48fc-b201-fefa4ded7092]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:03 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD
Jul 02 04:47:03 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:03 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD" returned: 0 in 0.787s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1708461489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aaddf50-16d6-4891-98f2-214320af2f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005e1b81b0b3468d8687fba8871d9320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:01Z,use_quota=True,user_id='4b1d978dec904b8a92f3fe2eff426ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Creating volume 3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:04 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:04 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1073741824
Jul 02 04:47:04 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:05 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1073741824" returned: 0 in 1.122s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:05 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:05 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:05 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 0.688s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Attempting download of 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume 3aaddf50-16d6-4891-98f2-214320af2f19. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad938ee-12c3-4ecb-b00e-2242212ac6af]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:06 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m
Jul 02 04:47:06 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m" returned: 0 in 0.935s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:06 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:07 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m
Jul 02 04:47:07 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:07 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m" returned: 1 in 0.737s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_n5kce_8m' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:47:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324c320-3685-46fb-984e-0dd43b052fb3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:07 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD
Jul 02 04:47:07 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:08 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD" returned: 0 in 0.845s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:08 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] 3cdb7750-2f67-439d-ab9d-6580dacde6f8 was qcow2, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 04:47:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:08 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:08 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Flow 'volume_create_manager' (60e5f8c9-69a5-4b0b-b810-657d66c4c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94892420-4c4c-434c-8ab9-8cbfe0f9d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94892420-4c4c-434c-8ab9-8cbfe0f9d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421937291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6806091-e4c8-4c38-bbc7-576f16d2d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ba6649bec84b368e7ae69f5b0e296c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:10Z,use_quota=True,user_id='5591fa4a73684d5ea6cd0496fd34204c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6004b5-673c-489a-b639-02c9d3a0fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6004b5-673c-489a-b639-02c9d3a0fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e6f6b-bd9e-4b8f-97a4-68a10926909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e6f6b-bd9e-4b8f-97a4-68a10926909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6806091-e4c8-4c38-bbc7-576f16d2d29e', 'volume_name': 'volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048c90b6-2f67-4943-a7f2-93f23747f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048c90b6-2f67-4943-a7f2-93f23747f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1802d626-11d9-4856-8ebd-a6eef58abe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:10 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Volume a6806091-e4c8-4c38-bbc7-576f16d2d29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e', 'volume_size': 1}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1421937291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6806091-e4c8-4c38-bbc7-576f16d2d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ba6649bec84b368e7ae69f5b0e296c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:10Z,use_quota=True,user_id='5591fa4a73684d5ea6cd0496fd34204c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Creating volume a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:10 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:10 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e 1073741824
Jul 02 04:47:10 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:10 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 2.433s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_b0u63h01devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:47:10 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Converted 112.00 MB image at 46.01 MB/s
Jul 02 04:47:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:10 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1G
Jul 02 04:47:11 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:11 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e 1073741824" returned: 0 in 1.107s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:11 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:47:11 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:11 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 1G" returned: 0 in 0.739s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d3183-f691-44df-8699-426debbb1fa3]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:11 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:11 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:12 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 0.759s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1802d626-11d9-4856-8ebd-a6eef58abe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3546921-8ad1-4177-a39e-0eceacbdb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:12 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Volume volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e (a6806091-e4c8-4c38-bbc7-576f16d2d29e): created successfully
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3546921-8ad1-4177-a39e-0eceacbdb44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Flow 'volume_create_manager' (60e5f8c9-69a5-4b0b-b810-657d66c4c777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6dd409fe-65f7-461d-be84-14b97184944d tempest-VolumesActionsTest-1266192186 None] Created volume successfully.
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "cinder-365a4614-7a6e-4e2a-b272-ecbdbf090e91-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "cinder-365a4614-7a6e-4e2a-b272-ecbdbf090e91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "cinder-quobyte-365a4614-7a6e-4e2a-b272-ecbdbf090e91" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "cinder-quobyte-365a4614-7a6e-4e2a-b272-ecbdbf090e91" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f137162-8d68-4105-b8c6-0915b3172995]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:12 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91
Jul 02 04:47:12 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:12 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 0.924s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:12 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:12 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:13 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91" returned: 0 in 0.752s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:13 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91
Jul 02 04:47:13 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:13 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 1 in 0.787s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Downloaded image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume 3aaddf50-16d6-4891-98f2-214320af2f19 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 for user 4b1d978dec904b8a92f3fe2eff426ebb is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Marking volume 3aaddf50-16d6-4891-98f2-214320af2f19 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Copying metadata from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 to 3aaddf50-16d6-4891-98f2-214320af2f19. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Creating volume glance metadata for volume 3aaddf50-16d6-4891-98f2-214320af2f19 backed by image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cb8734-5a88-432d-a258-419859fe145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aaddf50-16d6-4891-98f2-214320af2f19', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ef5910>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd109f1-4d2e-4528-ab9b-b435230079cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:13 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Volume volume-3aaddf50-16d6-4891-98f2-214320af2f19 (3aaddf50-16d6-4891-98f2-214320af2f19): created successfully
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd109f1-4d2e-4528-ab9b-b435230079cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Flow 'volume_create_manager' (56ab93f0-48e1-4136-baf1-7b352f6d3fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-34e355e6-8b64-41a2-9488-d2272092f065 tempest-VolumesExtendTest-775416406 None] Created volume successfully.
Jul 02 04:47:13 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-365a4614-7a6e-4e2a-b272-ecbdbf090e91" returned: 0 in 0.662s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "cinder-quobyte-365a4614-7a6e-4e2a-b272-ecbdbf090e91" released by "delete_volume" :: held 1.464s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:13 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Created reservations ['0440f64f-554a-4bd2-be77-266145c64c01', '4d814f77-f27b-4023-bb60-3e22f454bab1', '21ac1f6b-bc76-45f2-87bb-92ac6ee1b978', '6b7b4496-a003-4987-a9c3-c6b76428028b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:14 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:47:14 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:15 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.960s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:47:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Deleted volume successfully.
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b63385ff-5d3e-46a2-870d-a49dfa2516fe tempest-TaggedAttachmentsTest-711018766 None] Lock "cinder-365a4614-7a6e-4e2a-b272-ecbdbf090e91-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef23d8-b3ec-4f2d-9aa7-199c5746406c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:15 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:15 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (a05ff77f-298f-4896-800c-6b93cadcef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8439d7-55f2-425a-a538-5908cab525e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8439d7-55f2-425a-a538-5908cab525e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2034335156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5d02c7-0fd8-4c9d-b038-d62c5266832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:15Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65bedf5-345e-4ff4-8417-00e56093eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65bedf5-345e-4ff4-8417-00e56093eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2fb324-e9f1-4a01-9de6-08189eef67ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2fb324-e9f1-4a01-9de6-08189eef67ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5d02c7-0fd8-4c9d-b038-d62c5266832a', 'volume_name': 'volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b066bc-1605-489c-a8ef-d2d8779f1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b066bc-1605-489c-a8ef-d2d8779f1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcf548d-d74e-49bd-b4fa-66ea9b0bdd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:15 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Volume 3d5d02c7-0fd8-4c9d-b038-d62c5266832a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a', 'volume_size': 1}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:15 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 0.868s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:16 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:16 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:16 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 1 in 0.813s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 2G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 2G" returned: 0 in 0.072s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.840s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2034335156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5d02c7-0fd8-4c9d-b038-d62c5266832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:15Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Creating volume 3d5d02c7-0fd8-4c9d-b038-d62c5266832a {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:16 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:16 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a 1073741824
Jul 02 04:47:16 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4801ad9c-eb27-4f53-9c6b-dbe5e3d9aaac tempest-VolumesExtendTest-775416406 None] Extend volume completed successfully.
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-3aaddf50-16d6-4891-98f2-214320af2f19-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "cinder-3aaddf50-16d6-4891-98f2-214320af2f19-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-quobyte-3aaddf50-16d6-4891-98f2-214320af2f19" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3aaddf50-16d6-4891-98f2-214320af2f19" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ad221-1859-42c0-8332-bba761454778]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:17 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:17 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:17 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a 1073741824" returned: 0 in 0.970s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:17 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a
Jul 02 04:47:17 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:18 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 1.013s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:18 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:18 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:18 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" returned: 0 in 0.912s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcf548d-d74e-49bd-b4fa-66ea9b0bdd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f8a55-6583-4200-97d6-071db92f8fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:18 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Volume volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a (3d5d02c7-0fd8-4c9d-b038-d62c5266832a): created successfully
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f8a55-6583-4200-97d6-071db92f8fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (a05ff77f-298f-4896-800c-6b93cadcef3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5ab9a1fd-baaa-47c4-a6fe-cf15577b595c tempest-AttachVolumeNegativeTest-22984720 None] Created volume successfully.
Jul 02 04:47:19 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 1 in 0.925s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:47:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:19 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19
Jul 02 04:47:19 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:20 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3aaddf50-16d6-4891-98f2-214320af2f19" returned: 0 in 0.819s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3aaddf50-16d6-4891-98f2-214320af2f19" released by "delete_volume" :: held 2.846s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Created reservations ['005a3c6a-1d69-4b0d-b9a7-32ecb63232e3', '085ce4d6-4465-4a9f-a42f-3c23cc3a42db', '30f98968-505a-41fa-a8b9-6d9b667dafe7', '8ab74111-cd1b-4c62-a68b-78a9012d3716'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:20 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:47:20 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Flow 'volume_create_manager' (e2fd83f5-0f7b-44a3-8c17-2746c1515e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55badb86-722d-412c-801c-e868eadf5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55badb86-722d-412c-801c-e868eadf5717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-469455044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005e1b81b0b3468d8687fba8871d9320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:21Z,use_quota=True,user_id='4b1d978dec904b8a92f3fe2eff426ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1df6f1e-864f-4664-bdc9-11da9422ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1df6f1e-864f-4664-bdc9-11da9422ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42743c-0872-4010-9b79-311ce147f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42743c-0872-4010-9b79-311ce147f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df', 'volume_name': 'volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca8543c-ea30-4423-bd65-30184358319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca8543c-ea30-4423-bd65-30184358319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c7c29b-a9ef-4ad0-830c-b72d2e3073c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Volume 3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df', 'volume_size': 1}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-469455044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005e1b81b0b3468d8687fba8871d9320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:21Z,use_quota=True,user_id='4b1d978dec904b8a92f3fe2eff426ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Creating volume 3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:21 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:21 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df 1073741824
Jul 02 04:47:21 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:21 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.174s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:47:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Deleted volume successfully.
Jul 02 04:47:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4881f093-e247-4666-ba9b-d67264e64fa4 tempest-VolumesExtendTest-775416406 None] Lock "cinder-3aaddf50-16d6-4891-98f2-214320af2f19-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:22 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df 1073741824" returned: 0 in 0.993s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:22 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:22 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:23 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 0.744s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.300s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c7c29b-a9ef-4ad0-830c-b72d2e3073c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5e25b5-9fb9-47b6-aa3f-cdd06100cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8a86c-776e-4e57-82e9-6209ad177f54]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Volume volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df (3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df): created successfully
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5e25b5-9fb9-47b6-aa3f-cdd06100cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Flow 'volume_create_manager' (e2fd83f5-0f7b-44a3-8c17-2746c1515e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-94b1916d-2117-4ea9-9017-604c6cdbfcc5 tempest-VolumesExtendTest-775416406 None] Created volume successfully.
Jul 02 04:47:23 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a
Jul 02 04:47:23 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:24 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" returned: 0 in 0.909s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.943s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '759425a4-6ecc-4323-9d01-4b1692b249a9', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:47:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-865635e5-8c9b-471d-b954-73b9a9f41135 req-79d00917-7b48-4e47-bed6-4b94d2ff9a4e tempest-AttachVolumeNegativeTest-22984720 None] attachment_update completed successfully.
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Creating offline snapshot 80f71adf-1d64-44f8-a01f-20402cd3743c of volume 3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8884c9b-0ae3-4483-aa08-088eb18d6b9f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:25 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:25 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:25 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 0.909s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:25 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c 1G
Jul 02 04:47:25 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:26 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c 1G" returned: 0 in 0.858s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:26 devstack sudo[91330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c
Jul 02 04:47:26 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:27 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c" returned: 0 in 1.268s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:27 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c is being set with open permissions: ugo+rw
Jul 02 04:47:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:28 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c
Jul 02 04:47:28 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:28 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c" returned: 0 in 0.934s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:29 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info
Jul 02 04:47:29 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:30 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info" returned: 0 in 1.198s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:30 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info is being set with open permissions: ugo+rw
Jul 02 04:47:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:30 devstack sudo[91400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info
Jul 02 04:47:30 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8babaa5-0cce-407d-9cda-6ae7bc502d85 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" by "attach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8babaa5-0cce-407d-9cda-6ae7bc502d85 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" acquired by "attach_volume" :: waited 0.048s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b8babaa5-0cce-407d-9cda-6ae7bc502d85 tempest-VolumesActionsTest-1266192186 None] Attaching volume a6806091-e4c8-4c38-bbc7-576f16d2d29e to instance 6755a529-01d8-44e1-960c-7538c924a3ed at mountpoint /dev/vdb on host None.
Jul 02 04:47:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b8babaa5-0cce-407d-9cda-6ae7bc502d85 tempest-VolumesActionsTest-1266192186 None] Attach volume completed successfully.
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8babaa5-0cce-407d-9cda-6ae7bc502d85 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" released by "attach_volume" :: held 0.269s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:31 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.info" returned: 0 in 1.111s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.398s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5b72eaf6-5484-4eab-9aea-7d8ac5ee2771 tempest-VolumesExtendTest-775416406 None] Create snapshot completed successfully
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f8693205-2ba3-4ef7-a425-9f887b434937 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" by "detach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f8693205-2ba3-4ef7-a425-9f887b434937 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f8693205-2ba3-4ef7-a425-9f887b434937 tempest-VolumesActionsTest-1266192186 None] Detaching volume a6806091-e4c8-4c38-bbc7-576f16d2d29e from instance 6755a529-01d8-44e1-960c-7538c924a3ed.
Jul 02 04:47:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f8693205-2ba3-4ef7-a425-9f887b434937 tempest-VolumesActionsTest-1266192186 None] Detach volume completed successfully.
Jul 02 04:47:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f8693205-2ba3-4ef7-a425-9f887b434937 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:32 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a4cd0-3808-49c3-a665-7312d6331ac5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:32 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:32 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:33 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 1.039s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c 2G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c 2G" returned: 0 in 0.211s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.316s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e637c8fc-62a4-42d4-b6d2-aca53d0ec6f3 tempest-VolumesExtendTest-775416406 None] Extend volume completed successfully.
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-80f71adf-1d64-44f8-a01f-20402cd3743c-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-80f71adf-1d64-44f8-a01f-20402cd3743c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-quobyte-80f71adf-1d64-44f8-a01f-20402cd3743c" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-80f71adf-1d64-44f8-a01f-20402cd3743c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Deleting offline snapshot 80f71adf-1d64-44f8-a01f-20402cd3743c of volume 3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] snapshot_file for this snap is: volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fd70f-f7d8-4dc1-8801-23fcfefa65f5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:35 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c
Jul 02 04:47:35 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:36 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c" returned: 0 in 0.888s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:47:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f9592-ba74-4c3f-b31f-ee063feed2a0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:36 devstack sudo[91472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:36 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:37 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 0.933s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:37 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c
Jul 02 04:47:37 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:38 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c" returned: 0 in 0.968s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:38 devstack sudo[91519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c
Jul 02 04:47:38 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:38 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df.80f71adf-1d64-44f8-a01f-20402cd3743c" returned: 0 in 0.741s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-80f71adf-1d64-44f8-a01f-20402cd3743c" released by "_delete_snapshot" :: held 3.716s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" released by "delete_snapshot" :: held 3.754s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Created reservations ['7cbdfc62-e73e-46b0-a59b-1e876de62621', '26bf6713-bc63-4e09-8341-391500ca3bf6', 'bd407ffd-1a2e-4c2a-87bd-046ac7dea4f5', '1e070907-4629-4ced-86dc-b685c2116b6c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:47:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Delete snapshot completed successfully.
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-62a4c840-0fb9-4513-95e1-fb281718e1be tempest-VolumesExtendTest-775416406 None] Lock "cinder-80f71adf-1d64-44f8-a01f-20402cd3743c-delete_snapshot" released by "delete_snapshot" :: held 3.924s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "cinder-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Acquiring lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" acquired by "delete_volume" :: waited 0.013s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[511133d6-a6d1-4e15-b197-f8c5dc9883ff]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:47:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:39 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:39 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:40 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 1.078s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:40 devstack sudo[91530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df
Jul 02 04:47:40 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:41 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" returned: 0 in 1.166s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "cinder-quobyte-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df" released by "delete_volume" :: held 2.333s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=78,cinder:UPDATE=86,cinder:DELETE=5,cinder:INSERT=25 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Created reservations ['ff216d51-7494-492d-a291-5ffb95446e8c', '603aa787-be16-4b6f-bdf8-fb51b7f34dc2', 'e2f3ca84-4207-4716-80b7-1e2577796b1b', '18641d82-65d8-4bb5-a44b-b473756d03f5'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:42 devstack sudo[91556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:47:42 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:43 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.972s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:43 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:47:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Deleted volume successfully.
Jul 02 04:47:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b8f3c260-2386-4dfd-a39a-f4551fde173e tempest-VolumesExtendTest-775416406 None] Lock "cinder-3d0e590d-cb34-4a3a-a099-cf5fe7a5f4df-delete_volume" released by "delete_volume" :: held 3.633s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (2a7171d0-3681-4941-aa08-ec96b03e761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa776a-23b0-444b-a7bf-296a39fd143d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa776a-23b0-444b-a7bf-296a39fd143d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-810553143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e0ac20-c737-4965-8466-ed305e1943d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:49Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f6f2e-75b4-4a4e-a45b-4d3f95c2e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f6f2e-75b4-4a4e-a45b-4d3f95c2e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb59215-a17c-4ece-b42e-830338f5bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb59215-a17c-4ece-b42e-830338f5bb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e0ac20-c737-4965-8466-ed305e1943d9', 'volume_name': 'volume-50e0ac20-c737-4965-8466-ed305e1943d9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c9bde2-77c7-48fc-ab79-f4e824c2c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c9bde2-77c7-48fc-ab79-f4e824c2c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974cf788-8f54-4000-9f48-a5e75063ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Volume 50e0ac20-c737-4965-8466-ed305e1943d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e0ac20-c737-4965-8466-ed305e1943d9', 'volume_size': 1}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-810553143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e0ac20-c737-4965-8466-ed305e1943d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:49Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Creating volume 50e0ac20-c737-4965-8466-ed305e1943d9 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:49 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 1073741824
Jul 02 04:47:49 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:51 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 1073741824" returned: 0 in 1.424s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:INSERT=24,cinder:UPDATE=67,cinder:SELECT=68,cinder:DELETE=7 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:51 devstack sudo[91672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9
Jul 02 04:47:51 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:51 devstack sudo[91674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:47:51 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:52 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9" returned: 0 in 1.273s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] <== create_volume: return (2756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.759s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974cf788-8f54-4000-9f48-a5e75063ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e0ac20-c737-4965-8466-ed305e1943d9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389d102a-32dd-4c98-b199-c2d230383a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:52 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Volume volume-50e0ac20-c737-4965-8466-ed305e1943d9 (50e0ac20-c737-4965-8466-ed305e1943d9): created successfully
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389d102a-32dd-4c98-b199-c2d230383a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (2a7171d0-3681-4941-aa08-ec96b03e761e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d93730b0-8bf8-44d9-bd7f-26d8ce23617a tempest-VolumesListTestJSON-1921524490 None] Created volume successfully.
Jul 02 04:47:52 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.192s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:47:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (053ed429-db49-4d62-8be9-be5ca7e5eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b108946-9c75-4a3e-a684-1a734747c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b108946-9c75-4a3e-a684-1a734747c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1902255067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee44d616-a709-4681-b3b6-07e04fdf03db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:55Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18701e55-ba9b-485b-bb19-0a4eb74dedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18701e55-ba9b-485b-bb19-0a4eb74dedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8f2d9-26ea-457a-87ed-3155788e2674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8f2d9-26ea-457a-87ed-3155788e2674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee44d616-a709-4681-b3b6-07e04fdf03db', 'volume_name': 'volume-ee44d616-a709-4681-b3b6-07e04fdf03db', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a6eea-6944-4d28-a36b-abb17bcfddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a6eea-6944-4d28-a36b-abb17bcfddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca84f24-f641-46e1-a13f-68ec30aa90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Volume ee44d616-a709-4681-b3b6-07e04fdf03db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee44d616-a709-4681-b3b6-07e04fdf03db', 'volume_size': 1}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1902255067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee44d616-a709-4681-b3b6-07e04fdf03db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:55Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Creating volume ee44d616-a709-4681-b3b6-07e04fdf03db {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:54 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:54 devstack sudo[91694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db 1073741824
Jul 02 04:47:54 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:55 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db 1073741824" returned: 0 in 0.984s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:55 devstack sudo[91709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db
Jul 02 04:47:55 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:47:56 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db" returned: 0 in 0.819s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca84f24-f641-46e1-a13f-68ec30aa90fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee44d616-a709-4681-b3b6-07e04fdf03db', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3d303-3f03-454a-badb-ad216a87ed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Volume volume-ee44d616-a709-4681-b3b6-07e04fdf03db (ee44d616-a709-4681-b3b6-07e04fdf03db): created successfully
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3d303-3f03-454a-badb-ad216a87ed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (053ed429-db49-4d62-8be9-be5ca7e5eddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-837083c2-3b1a-4bfb-a841-85e275bc5a8d tempest-VolumesListTestJSON-1921524490 None] Created volume successfully.
Jul 02 04:47:58 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (85645a7c-7db8-4461-8e6f-e40e69c76ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfb6742-4e3a-4f26-b35a-d79d0633c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfb6742-4e3a-4f26-b35a-d79d0633c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1605978568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6ad42a-5e85-4370-b940-c97490876cf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:59Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acafb9e-bb6a-4a2b-913a-d29b830fd289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acafb9e-bb6a-4a2b-913a-d29b830fd289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dfbdc7-a299-4fda-b88b-5a1843f6262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dfbdc7-a299-4fda-b88b-5a1843f6262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6ad42a-5e85-4370-b940-c97490876cf5', 'volume_name': 'volume-2c6ad42a-5e85-4370-b940-c97490876cf5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb26e5c-fa5b-49f5-8ef1-f1074fd4aec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb26e5c-fa5b-49f5-8ef1-f1074fd4aec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837f8234-c0ce-4467-b05c-c45915993602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:47:59 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Volume 2c6ad42a-5e85-4370-b940-c97490876cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6ad42a-5e85-4370-b940-c97490876cf5', 'volume_size': 1}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1605978568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6ad42a-5e85-4370-b940-c97490876cf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aedc30fe61ec427399a0a7de51ba2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:47:59Z,use_quota=True,user_id='c8b6b276f1184412bcc906b591e035f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Creating volume 2c6ad42a-5e85-4370-b940-c97490876cf5 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:47:59 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:47:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:47:59 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 1073741824
Jul 02 04:47:59 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:00 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 1073741824" returned: 0 in 1.018s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:00 devstack sudo[91792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5
Jul 02 04:48:00 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-94f26346-9b89-4d90-97e9-3de5ca73b1c4 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" by "attach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-94f26346-9b89-4d90-97e9-3de5ca73b1c4 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" acquired by "attach_volume" :: waited 0.047s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-94f26346-9b89-4d90-97e9-3de5ca73b1c4 tempest-VolumesActionsTest-1266192186 None] Attaching volume a6806091-e4c8-4c38-bbc7-576f16d2d29e to instance 0720cdef-1230-41a7-9ad9-046861a08aaa at mountpoint /dev/vdb on host None.
Jul 02 04:48:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-94f26346-9b89-4d90-97e9-3de5ca73b1c4 tempest-VolumesActionsTest-1266192186 None] Attach volume completed successfully.
Jul 02 04:48:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-94f26346-9b89-4d90-97e9-3de5ca73b1c4 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e" released by "attach_volume" :: held 0.278s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-44b5f62c-b0ac-4481-b826-e067c1108a15 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" by "detach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-44b5f62c-b0ac-4481-b826-e067c1108a15 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-44b5f62c-b0ac-4481-b826-e067c1108a15 tempest-VolumesActionsTest-1266192186 None] Detaching volume a6806091-e4c8-4c38-bbc7-576f16d2d29e from instance 0720cdef-1230-41a7-9ad9-046861a08aaa.
Jul 02 04:48:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-44b5f62c-b0ac-4481-b826-e067c1108a15 tempest-VolumesActionsTest-1266192186 None] Detach volume completed successfully.
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-44b5f62c-b0ac-4481-b826-e067c1108a15 tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:02 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5" returned: 0 in 2.242s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] <== create_volume: return (3354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.356s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837f8234-c0ce-4467-b05c-c45915993602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6ad42a-5e85-4370-b940-c97490876cf5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0d1c91-81d1-4f52-97d0-78278cc58082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:02 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Volume volume-2c6ad42a-5e85-4370-b940-c97490876cf5 (2c6ad42a-5e85-4370-b940-c97490876cf5): created successfully
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0d1c91-81d1-4f52-97d0-78278cc58082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Flow 'volume_create_manager' (85645a7c-7db8-4461-8e6f-e40e69c76ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:48:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c15568ab-d646-4d4b-8bcd-6c3e0c45747a tempest-VolumesListTestJSON-1921524490 None] Created volume successfully.
Jul 02 04:48:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-2c6ad42a-5e85-4370-b940-c97490876cf5-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-2c6ad42a-5e85-4370-b940-c97490876cf5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-quobyte-2c6ad42a-5e85-4370-b940-c97490876cf5" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-2c6ad42a-5e85-4370-b940-c97490876cf5" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16c2b0-15d6-47c9-b463-8a028d4a8937]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:07 devstack sudo[91934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5
Jul 02 04:48:07 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:07 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5" returned: 0 in 0.822s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:07 devstack sudo[91939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5
Jul 02 04:48:07 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:08 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c6ad42a-5e85-4370-b940-c97490876cf5" returned: 0 in 0.653s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-2c6ad42a-5e85-4370-b940-c97490876cf5" released by "delete_volume" :: held 1.532s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Created reservations ['56590bd3-7b2f-429c-87cf-20158c16ba99', '6b7fffa9-dd48-4a2c-8afd-1c1ed35bb68c', '54a65645-13ec-4429-8e8b-c79c44f9e4b6', '16d13022-d390-4ee9-a929-688aaacee9fd'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:08 devstack sudo[91942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:48:08 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-ee44d616-a709-4681-b3b6-07e04fdf03db-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-ee44d616-a709-4681-b3b6-07e04fdf03db-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-quobyte-ee44d616-a709-4681-b3b6-07e04fdf03db" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-ee44d616-a709-4681-b3b6-07e04fdf03db" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[481202bb-ded4-42e6-8b75-6859f9b3da92]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:09 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:48:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Deleted volume successfully.
Jul 02 04:48:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0ecba362-185f-45cd-81d2-b8f3d9733f6e tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-2c6ad42a-5e85-4370-b940-c97490876cf5-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:09 devstack sudo[91945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db
Jul 02 04:48:09 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:10 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db" returned: 0 in 0.854s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:10 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db
Jul 02 04:48:10 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee44d616-a709-4681-b3b6-07e04fdf03db" returned: 0 in 0.752s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:11 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-ee44d616-a709-4681-b3b6-07e04fdf03db" released by "delete_volume" :: held 1.654s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Created reservations ['055b7e51-b4d4-47f1-b06e-68627ed6ea2f', 'eca54ad2-330e-4ef7-a027-3926b2a08ee4', '2c09bffd-10eb-4800-be59-4f20672f8b8f', 'c0246381-7e92-4001-b2dd-62c796797c43'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:11 devstack sudo[91954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:48:11 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2633c8-d8f2-4c2c-9961-b3ac6535d4e5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-50e0ac20-c737-4965-8466-ed305e1943d9-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-50e0ac20-c737-4965-8466-ed305e1943d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:11 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:48:11 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "cinder-quobyte-50e0ac20-c737-4965-8466-ed305e1943d9" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-50e0ac20-c737-4965-8466-ed305e1943d9" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e4cd0-63bc-41df-abda-348d799c8dbb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:12 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:12 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9
Jul 02 04:48:12 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:48:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Deleted volume successfully.
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-03462cdc-7dfa-4b08-80f9-546fdee0d004 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-ee44d616-a709-4681-b3b6-07e04fdf03db-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:12 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0872a678-3149-4912-9f2d-154798f9e47e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:12 devstack sudo[91978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:48:12 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:12 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9" returned: 0 in 0.912s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:12 devstack sudo[91984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9
Jul 02 04:48:12 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:13 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 0.901s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.8b9b1363-24be-4758-9fb1-0c490b7178dau7e33xuv.img {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:13 devstack sudo[91990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.8b9b1363-24be-4758-9fb1-0c490b7178dau7e33xuv.img
Jul 02 04:48:13 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:13 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50e0ac20-c737-4965-8466-ed305e1943d9" returned: 0 in 0.767s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-quobyte-50e0ac20-c737-4965-8466-ed305e1943d9" released by "delete_volume" :: held 1.742s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Created reservations ['684853c5-945d-460d-aaeb-05ecb5af7687', '9a32e0cb-7e7b-4677-ab98-5f3cc28dd171', '0e2d96a1-c4fa-48f1-9551-6464fb05828d', '906a655e-59c7-4943-8441-d6210c452fa1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:13 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:48:13 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:15 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.489s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:15 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:48:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Deleted volume successfully.
Jul 02 04:48:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5b9b5ac7-f6ef-4207-b4f3-7d950266dca4 tempest-VolumesListTestJSON-1921524490 None] Lock "cinder-50e0ac20-c737-4965-8466-ed305e1943d9-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:48:20 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.8b9b1363-24be-4758-9fb1-0c490b7178dau7e33xuv.img" returned: 0 in 6.830s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a73b39-a202-47a1-a46e-b5e5f2657452]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:20 devstack sudo[92070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:48:20 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:21 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 1.161s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:21 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.8b9b1363-24be-4758-9fb1-0c490b7178dau7e33xuv.img {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:48:21 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Converted 1024.00 MB image at 149.90 MB/s
Jul 02 04:48:21 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] 8b9b1363-24be-4758-9fb1-0c490b7178da was raw, no need to convert to raw {{(pid=86158) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Flow 'volume_create_manager' (6fabe65b-85c8-41d3-a37a-892fc6177ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc713a5-6273-414e-bea9-a9804d09a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc713a5-6273-414e-bea9-a9804d09a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1813102929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7a5d1d-272b-46d1-b060-32d0b9d1407a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a48261513c4701b112151e84c717d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:48:27Z,use_quota=True,user_id='25d04677eda542c2b2df8d74b5aff266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98857e05-fe3d-48b2-9629-f5282d2cd936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98857e05-fe3d-48b2-9629-f5282d2cd936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1903061c-e224-4fa9-bbc7-cfd2b835fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1903061c-e224-4fa9-bbc7-cfd2b835fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'volume_name': 'volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b2da4c-96c2-4326-b02a-49109a6f518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b2da4c-96c2-4326-b02a-49109a6f518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c9b7b-7997-484c-a272-cef27139042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Volume fc7a5d1d-272b-46d1-b060-32d0b9d1407a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'volume_size': 1}
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-e5dd0cb0-f789-4592-89f1-961ecc4e30af req-ea2100f2-1095-4f4d-92ab-630e311bd2e9 tempest-AttachVolumeNegativeTest-22984720 None] Terminate volume connection completed successfully.
Jul 02 04:48:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-e5dd0cb0-f789-4592-89f1-961ecc4e30af req-ea2100f2-1095-4f4d-92ab-630e311bd2e9 tempest-AttachVolumeNegativeTest-22984720 None] Deleting attachment 759425a4-6ecc-4323-9d01-4b1692b249a9. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:48:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:INSERT=10,cinder:UPDATE=52,cinder:SELECT=31,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:48:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=30,cinder:SELECT=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.295s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Uploaded volume to glance image-id: 8b9b1363-24be-4758-9fb1-0c490b7178da. {{(pid=86158) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.415s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1813102929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7a5d1d-272b-46d1-b060-32d0b9d1407a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a48261513c4701b112151e84c717d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:48:27Z,use_quota=True,user_id='25d04677eda542c2b2df8d74b5aff266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Creating volume fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:48:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:48:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:49 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a 1073741824
Jul 02 04:48:49 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c48c7d37-20bc-4003-8e3d-7099b46d4b24 tempest-VolumesActionsTest-1266192186 None] Copy volume to image completed successfully.
Jul 02 04:48:51 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a 1073741824" returned: 0 in 1.226s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:51 devstack sudo[92254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a
Jul 02 04:48:51 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:51 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:48:51 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:48:52 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" returned: 0 in 1.025s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.128s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c9b7b-7997-484c-a272-cef27139042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe2e361-b984-4287-900c-8373f70fe4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3525469-8517-43d8-9b65-ea84b10a9472]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:52 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Volume volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a (fc7a5d1d-272b-46d1-b060-32d0b9d1407a): created successfully
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe2e361-b984-4287-900c-8373f70fe4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Flow 'volume_create_manager' (6fabe65b-85c8-41d3-a37a-892fc6177ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:48:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7a497a7d-b6d9-4be4-be63-033f2757a738 tempest-ServerActionsTestOtherA-1062174158 None] Created volume successfully.
Jul 02 04:48:52 devstack sudo[92259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:48:52 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:52 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.812s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:48:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:48:53 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 0.936s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77162c8-b66c-446a-857d-96576f79959d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:53 devstack sudo[92265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:48:53 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Flow 'volume_create_manager' (d494502e-0626-4b6e-a0fe-5d4318a9e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd77335-bf10-4186-a300-b06ff71a8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd77335-bf10-4186-a300-b06ff71a8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1144451312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe64cb7-b8a2-47c8-8960-24507df90516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74b777cd03946dfaed89e7b88964a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:48:54Z,use_quota=True,user_id='2a093c4f621a4340aa01f264062ef872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a969944d-0979-4471-b7ba-720bb9e67d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a969944d-0979-4471-b7ba-720bb9e67d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee87135a-c2c7-4f59-a4f6-fb3a4ddfa8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 04:48:54 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 1.067s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:54 devstack sudo[92270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img
Jul 02 04:48:54 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee87135a-c2c7-4f59-a4f6-fb3a4ddfa8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffe64cb7-b8a2-47c8-8960-24507df90516', 'volume_name': 'volume-ffe64cb7-b8a2-47c8-8960-24507df90516', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd4dd0>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b370a4dd-5f16-4515-91ed-1f29c8c5c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b370a4dd-5f16-4515-91ed-1f29c8c5c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065fa0ea-7231-4029-bf84-c1759561d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:48:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Volume ffe64cb7-b8a2-47c8-8960-24507df90516: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffe64cb7-b8a2-47c8-8960-24507df90516', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd4dd0>}
Jul 02 04:48:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Trying to clone ffe64cb7-b8a2-47c8-8960-24507df90516 from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 04:48:55 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 04:48:55 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 04:48:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b619ddb-f3d3-45e3-9391-f521bf8c82fb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:56 devstack sudo[92279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD
Jul 02 04:48:56 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:48:58 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root
Jul 02 04:48:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD" returned: 0 in 3.493s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:48:58 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 is fetched for user 2a093c4f621a4340aa01f264062ef872. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 04:48:59 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db0fa7-ac34-4ab4-9de8-32f294d0ad8e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:48:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:48:59 devstack sudo[92308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD
Jul 02 04:48:59 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:02 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD" returned: 0 in 3.029s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:04 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img" returned: 0 in 9.726s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bcf246-d8d9-4e3b-be74-0a05b8e8e1ad]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:04 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:49:04 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:05 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 1.009s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:49:05 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Converted 1024.00 MB image at 105.20 MB/s
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] 7173320a-d266-4a7c-a24a-2ce8f9998a85 was raw, converting to qcow2 {{(pid=86158) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12fa41-a4ab-471b-bb9a-9a55d0ee3fc3]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:05 devstack sudo[92323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img
Jul 02 04:49:05 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:05 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img" returned: 0 in 0.791s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:06 devstack sudo[92327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img
Jul 02 04:49:06 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:06 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img" returned: 1 in 0.746s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:49:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img /opt/stack/data/cinder/conversion/vol_upload_is66hw30 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:06 devstack sudo[92336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img /opt/stack/data/cinder/conversion/vol_upload_is66hw30
Jul 02 04:49:06 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:07 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img /opt/stack/data/cinder/conversion/vol_upload_is66hw30" returned: 0 in 0.665s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:07 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Image conversion details: src /opt/stack/data/cinder/conversion/a6806091-e4c8-4c38-bbc7-576f16d2d29e.temp_image.7173320a-d266-4a7c-a24a-2ce8f9998a85bkq5vkyq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_is66hw30 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:49:07 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 02 04:49:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7619f74-72a7-488c-9f8e-f0b1484b8a96]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_is66hw30 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:07 devstack sudo[92341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_is66hw30
Jul 02 04:49:07 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:08 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_is66hw30" returned: 0 in 1.033s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:09 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.928s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Uploaded volume to glance image-id: 7173320a-d266-4a7c-a24a-2ce8f9998a85. {{(pid=86158) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.910s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1144451312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe64cb7-b8a2-47c8-8960-24507df90516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74b777cd03946dfaed89e7b88964a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:48:54Z,use_quota=True,user_id='2a093c4f621a4340aa01f264062ef872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Creating volume ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:10 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:10 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1073741824
Jul 02 04:49:10 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-cee8abf0-0e23-43cd-b0d4-d3d35a6148f3 tempest-VolumesActionsTest-1266192186 None] Copy volume to image completed successfully.
Jul 02 04:49:11 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1073741824" returned: 0 in 1.144s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:11 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:11 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Acquiring lock "cinder-quobyte-a6806091-e4c8-4c38-bbc7-576f16d2d29e" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "cinder-quobyte-a6806091-e4c8-4c38-bbc7-576f16d2d29e" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62124b1-96ef-49fb-bbd6-be6fd2344299]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:11 devstack sudo[92447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:49:11 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:12 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 0.986s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Attempting download of 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume ffe64cb7-b8a2-47c8-8960-24507df90516. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d64af5-0e63-4f28-b9df-67beaffb4576]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:12 devstack sudo[92451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74
Jul 02 04:49:12 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:12 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 1.052s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:12 devstack sudo[92457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e
Jul 02 04:49:12 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:13 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:13 devstack sudo[92461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74
Jul 02 04:49:13 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:13 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6806091-e4c8-4c38-bbc7-576f16d2d29e" returned: 0 in 0.717s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "cinder-quobyte-a6806091-e4c8-4c38-bbc7-576f16d2d29e" released by "delete_volume" :: held 1.832s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Created reservations ['c3b27c1d-a815-4ac8-8658-210610505eb4', '667c8d35-0c3c-4176-af28-6967b14708ce', '37f59720-e8f0-409c-9035-2142420e3cee', 'dd87ce39-4232-42de-b7cc-d5be2ec6d921'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:13 devstack sudo[92464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:49:13 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:14 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74" returned: 1 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_1mya1t74' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d76bf-df06-46f2-8208-853f18e0a313]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:14 devstack sudo[92468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD
Jul 02 04:49:14 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:14 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:49:14 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Deleted volume successfully.
Jul 02 04:49:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e436e11d-0d78-44c7-9027-bc8ac711a2fb tempest-VolumesActionsTest-1266192186 None] Lock "cinder-a6806091-e4c8-4c38-bbc7-576f16d2d29e-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:15 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD" returned: 0 in 0.935s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:15 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] 3cdb7750-2f67-439d-ab9d-6580dacde6f8 was qcow2, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 04:49:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:15 devstack sudo[92474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:15 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:17 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 2.511s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:17 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_d3p5c_w5devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:49:17 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Converted 112.00 MB image at 44.54 MB/s
Jul 02 04:49:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:17 devstack sudo[92489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1G
Jul 02 04:49:17 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:18 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 1G" returned: 0 in 1.150s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83e8cc-06c3-4811-9d2a-e215b3cf1c81]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:19 devstack sudo[92495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:19 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:19 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 0.854s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:19 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:19 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:20 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 1 in 0.815s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Downloaded image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume ffe64cb7-b8a2-47c8-8960-24507df90516 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 for user 2a093c4f621a4340aa01f264062ef872 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Marking volume ffe64cb7-b8a2-47c8-8960-24507df90516 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Copying metadata from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 to ffe64cb7-b8a2-47c8-8960-24507df90516. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Creating volume glance metadata for volume ffe64cb7-b8a2-47c8-8960-24507df90516 backed by image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065fa0ea-7231-4029-bf84-c1759561d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe64cb7-b8a2-47c8-8960-24507df90516', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd4dd0>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b76ca-446a-40d8-ac9c-7b14e4a31baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:20 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Volume volume-ffe64cb7-b8a2-47c8-8960-24507df90516 (ffe64cb7-b8a2-47c8-8960-24507df90516): created successfully
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b76ca-446a-40d8-ac9c-7b14e4a31baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:20 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Flow 'volume_create_manager' (d494502e-0626-4b6e-a0fe-5d4318a9e66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:20 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ea3b6457-03b8-4e96-9720-6f254388a46b tempest-TestShelveInstance-1392562446 None] Created volume successfully.
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (abb35114-0848-43d2-a45f-ca5873f862c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ecc865-9756-4268-8321-dfd1f273595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ecc865-9756-4268-8321-dfd1f273595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1315993554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d200abf4-79ae-488e-bf5f-79d893a3a913,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:21Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e8bd32-64c1-4332-8762-1342c7723831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e8bd32-64c1-4332-8762-1342c7723831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf706cda-3097-4a02-b130-9537a229b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf706cda-3097-4a02-b130-9537a229b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd200abf4-79ae-488e-bf5f-79d893a3a913', 'volume_name': 'volume-d200abf4-79ae-488e-bf5f-79d893a3a913', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911a0b4a-4585-4304-b601-ce7ba9a265fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911a0b4a-4585-4304-b601-ce7ba9a265fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e664e36-f2bf-4ab3-8efa-da519f85382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Volume d200abf4-79ae-488e-bf5f-79d893a3a913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d200abf4-79ae-488e-bf5f-79d893a3a913', 'volume_size': 1}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1315993554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d200abf4-79ae-488e-bf5f-79d893a3a913,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:21Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Creating volume d200abf4-79ae-488e-bf5f-79d893a3a913 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:21 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:21 devstack sudo[92507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 1073741824
Jul 02 04:49:21 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:22 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 1073741824" returned: 0 in 0.975s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:22 devstack sudo[92533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913
Jul 02 04:49:22 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:22 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e664e36-f2bf-4ab3-8efa-da519f85382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d200abf4-79ae-488e-bf5f-79d893a3a913', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eee4a7d-c994-4341-9127-a44e26c78b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:22 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Volume volume-d200abf4-79ae-488e-bf5f-79d893a3a913 (d200abf4-79ae-488e-bf5f-79d893a3a913): created successfully
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eee4a7d-c994-4341-9127-a44e26c78b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (abb35114-0848-43d2-a45f-ca5873f862c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-159fa6e7-b29b-48da-a6e4-1ef25cdad151 tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (45101bd9-1980-4f36-b600-2df95e8235ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d934120-01ff-4423-b20d-515a3b3eace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d934120-01ff-4423-b20d-515a3b3eace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-176396983',display_name='tempest-VolumesGetTest-Volume-59122416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c28b4c-dc4a-49be-b2c8-cffd24eeda83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:24Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0a7e89-147d-42fd-a95a-3ac378b9368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0a7e89-147d-42fd-a95a-3ac378b9368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d78011-9f30-4021-a20f-59be17d4574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d78011-9f30-4021-a20f-59be17d4574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c28b4c-dc4a-49be-b2c8-cffd24eeda83', 'volume_name': 'volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143980b1-2b2f-46ba-9652-6db26e29f929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143980b1-2b2f-46ba-9652-6db26e29f929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6e22ca-b4e6-4404-989f-28d636307067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Volume c7c28b4c-dc4a-49be-b2c8-cffd24eeda83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83', 'volume_size': 1}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-176396983',display_name='tempest-VolumesGetTest-Volume-59122416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c28b4c-dc4a-49be-b2c8-cffd24eeda83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:24Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Creating volume c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:24 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:24 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 1073741824
Jul 02 04:49:24 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:24 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 1073741824" returned: 0 in 0.915s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:24 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83
Jul 02 04:49:24 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:25 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" returned: 0 in 0.638s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6e22ca-b4e6-4404-989f-28d636307067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07419af3-95ce-4710-a7e3-d52c0cdebbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:25 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Volume volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 (c7c28b4c-dc4a-49be-b2c8-cffd24eeda83): created successfully
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07419af3-95ce-4710-a7e3-d52c0cdebbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (45101bd9-1980-4f36-b600-2df95e8235ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:25 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6405fd56-48ca-41c7-89a7-4f6711ad366e tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "cinder-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" acquired by "delete_volume" :: waited 0.013s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa933943-0725-4dfa-9bd9-9c3f24363e13]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:26 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83
Jul 02 04:49:26 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:26 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" returned: 0 in 0.789s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:27 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83
Jul 02 04:49:27 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:27 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83" released by "delete_volume" :: held 1.573s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Created reservations ['1c3588f2-e59d-4f6d-af1f-247a135bac21', 'e2654a6f-f84e-4497-a564-b4089679f305', '82b811e9-44be-45f3-9cdf-eb1c9297bc34', 'b03066c0-feab-4c69-857f-1cdd12ad7c52'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e960f7-a917-4685-8f28-08d834191963]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:28 devstack sudo[92589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:49:28 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:28 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a
Jul 02 04:49:28 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-d200abf4-79ae-488e-bf5f-79d893a3a913-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "cinder-d200abf4-79ae-488e-bf5f-79d893a3a913-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-d200abf4-79ae-488e-bf5f-79d893a3a913" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-d200abf4-79ae-488e-bf5f-79d893a3a913" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b3732b-a320-44ad-86f7-37b6b6dbc52a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:29 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" returned: 0 in 1.152s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.184s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92ab4d11-9fbd-45a4-a950-4a038644b664', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:49:29 devstack sudo[92595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913
Jul 02 04:49:29 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-b7e7e6cb-10a6-4c1f-8784-8025f2ac785f req-6d1878bd-945c-4841-b2fd-03df03436d77 tempest-ServerActionsTestOtherA-1062174158 None] attachment_update completed successfully.
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:29 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.483s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:49:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5cb08-2534-424b-b3f2-ec1d491e4801]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5435210f-d296-4ed3-bfb8-8c08e174021e tempest-VolumesGetTest-1723212300 None] Lock "cinder-c7c28b4c-dc4a-49be-b2c8-cffd24eeda83-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:29 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:29 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:30 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913" returned: 0 in 1.220s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:30 devstack sudo[92679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913
Jul 02 04:49:30 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:30 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 1.269s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:30 devstack sudo[93002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:49:30 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:31 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d200abf4-79ae-488e-bf5f-79d893a3a913" returned: 0 in 0.928s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-d200abf4-79ae-488e-bf5f-79d893a3a913" released by "delete_volume" :: held 2.228s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Created reservations ['8a6e1524-bf75-42ab-bbbd-58aa3ebdfe6d', '187b73f0-aeff-45af-bb7f-2c91ac329ebb', '06bf6b01-0825-4b1b-a14b-3ba8bd125b8a', '0c395b52-8f08-463a-a6e7-039cd28118b1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:31 devstack sudo[93005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:49:31 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:31 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 1 in 0.848s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.210s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-ffe64cb7-b8a2-47c8-8960-24507df90516', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f18dbb-a27c-437b-a041-11e1d0c2a68f', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:49:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-d6d6fe20-469a-4e9f-932c-e0a269d51e55 req-f971bba1-3052-48e2-b9af-b51416163231 tempest-TestShelveInstance-1392562446 None] attachment_update completed successfully.
Jul 02 04:49:32 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.758s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:49:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:49:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-234200f8-fbe9-49f1-bed6-ace4acd300fd tempest-VolumesGetTest-1723212300 None] Lock "cinder-d200abf4-79ae-488e-bf5f-79d893a3a913-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (81a27c3f-b1e4-4982-a86f-1bff286e4859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb58c768-201c-419c-8ddb-691be97fa87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb58c768-201c-419c-8ddb-691be97fa87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-531039916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2160a7-cf7d-485c-8a27-5799faec5869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:33Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb15d6d0-77e2-4243-873e-49cc4d216dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb15d6d0-77e2-4243-873e-49cc4d216dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc6ba70-01d6-4880-93dd-7bf769a26493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc6ba70-01d6-4880-93dd-7bf769a26493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2160a7-cf7d-485c-8a27-5799faec5869', 'volume_name': 'volume-df2160a7-cf7d-485c-8a27-5799faec5869', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1321cd93-04cf-4032-b0e3-337b2c4b5703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1321cd93-04cf-4032-b0e3-337b2c4b5703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a788acb-e77b-4786-98fd-284d862077c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Volume df2160a7-cf7d-485c-8a27-5799faec5869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2160a7-cf7d-485c-8a27-5799faec5869', 'volume_size': 1}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-531039916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2160a7-cf7d-485c-8a27-5799faec5869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:33Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Creating volume df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:33 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:33 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 1073741824
Jul 02 04:49:33 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (b535995f-7f65-4612-92e5-298ee4726075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf51c38a-9d9c-48da-b58c-a904cd4af96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf51c38a-9d9c-48da-b58c-a904cd4af96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1158448847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9370cac-1540-47e0-8b54-5b5edea1e279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:33Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8a6f05-1962-4b53-83a1-68d62378810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8a6f05-1962-4b53-83a1-68d62378810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bde3e81-82af-4de4-b2ad-0a7687f0b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bde3e81-82af-4de4-b2ad-0a7687f0b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9370cac-1540-47e0-8b54-5b5edea1e279', 'volume_name': 'volume-f9370cac-1540-47e0-8b54-5b5edea1e279', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c00e11-fa29-44d3-8f10-e4745dffad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c00e11-fa29-44d3-8f10-e4745dffad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d540353-9978-4bb6-a55e-17d0789955f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Volume f9370cac-1540-47e0-8b54-5b5edea1e279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9370cac-1540-47e0-8b54-5b5edea1e279', 'volume_size': 1}
Jul 02 04:49:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:34 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 1073741824" returned: 0 in 0.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:34 devstack sudo[93020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:49:34 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:34 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 0.707s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1158448847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9370cac-1540-47e0-8b54-5b5edea1e279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:33Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Creating volume f9370cac-1540-47e0-8b54-5b5edea1e279 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:34 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a788acb-e77b-4786-98fd-284d862077c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2160a7-cf7d-485c-8a27-5799faec5869', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18adfb8-5b6e-46c1-b44c-a1189b3a3437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:34 devstack sudo[93023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 1073741824
Jul 02 04:49:34 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Volume volume-df2160a7-cf7d-485c-8a27-5799faec5869 (df2160a7-cf7d-485c-8a27-5799faec5869): created successfully
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18adfb8-5b6e-46c1-b44c-a1189b3a3437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (81a27c3f-b1e4-4982-a86f-1bff286e4859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-93d7fe92-91d8-4223-b40e-fa69b2da4451 tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:49:35 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 1073741824" returned: 0 in 0.974s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:35 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279
Jul 02 04:49:35 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:36 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279" returned: 0 in 0.880s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d540353-9978-4bb6-a55e-17d0789955f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9370cac-1540-47e0-8b54-5b5edea1e279', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3232fa54-03dd-4759-a9f6-6342fcd8aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Volume volume-f9370cac-1540-47e0-8b54-5b5edea1e279 (f9370cac-1540-47e0-8b54-5b5edea1e279): created successfully
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3232fa54-03dd-4759-a9f6-6342fcd8aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (b535995f-7f65-4612-92e5-298ee4726075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:36 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7760e509-3e96-4a2f-9eb8-cb9d13790e77 tempest-AttachVolumeNegativeTest-22984720 None] Created volume successfully.
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (0018a453-f35f-4b40-8e76-636eb986115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7d980c-3da1-4d45-9a46-2240db7ce6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7d980c-3da1-4d45-9a46-2240db7ce6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1614714216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cf9077-631c-4a14-9052-c8fd9b68e71d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=df2160a7-cf7d-485c-8a27-5799faec5869,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:37Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0baefa-49e1-4ef9-94ca-353bd5e2e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0baefa-49e1-4ef9-94ca-353bd5e2e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485b095-0833-49e6-a52a-c48041393460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485b095-0833-49e6-a52a-c48041393460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '51cf9077-631c-4a14-9052-c8fd9b68e71d', 'volume_name': 'volume-51cf9077-631c-4a14-9052-c8fd9b68e71d', 'volume_size': 1, 'source_volid': 'df2160a7-cf7d-485c-8a27-5799faec5869', 'source_volstatus': 'available'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f26afb-02b1-4f8f-890a-ce4766d306ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f26afb-02b1-4f8f-890a-ce4766d306ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ccc83c-7424-4568-9beb-22d2ac41aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Volume 51cf9077-631c-4a14-9052-c8fd9b68e71d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-51cf9077-631c-4a14-9052-c8fd9b68e71d', 'volume_size': 1, 'source_volid': 'df2160a7-cf7d-485c-8a27-5799faec5869', 'source_volstatus': 'available'}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:37 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Cloning volume df2160a7-cf7d-485c-8a27-5799faec5869 to volume 51cf9077-631c-4a14-9052-c8fd9b68e71d
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Creating offline snapshot a8fcae95-e956-42d1-919b-5d015ee00c66 of volume df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbedda53-afb4-4f39-8a6d-1d5d3fc96dcd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:37 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:49:37 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-bf200aa1-c7a2-4ec1-8140-df0690c5b9ad tempest-ServerActionsTestOtherA-1062174158 None] Terminate volume connection completed successfully.
Jul 02 04:49:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-bf200aa1-c7a2-4ec1-8140-df0690c5b9ad tempest-ServerActionsTestOtherA-1062174158 None] Deleting attachment 92ab4d11-9fbd-45a4-a950-4a038644b664. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:49:38 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 1.495s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:38 devstack sudo[93205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 1G
Jul 02 04:49:38 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:40 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 1G" returned: 0 in 1.218s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2160a7-cf7d-485c-8a27-5799faec5869 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:40 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2160a7-cf7d-485c-8a27-5799faec5869 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:40 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:41 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2160a7-cf7d-485c-8a27-5799faec5869 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 1.150s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:41 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 is being set with open permissions: ugo+rw
Jul 02 04:49:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:41 devstack sudo[93239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:41 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:42 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 0.825s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:42 devstack sudo[93254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info
Jul 02 04:49:42 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:42 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info" returned: 0 in 0.801s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:42 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info is being set with open permissions: ugo+rw
Jul 02 04:49:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:42 devstack sudo[93261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info
Jul 02 04:49:42 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:43 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.info" returned: 0 in 0.928s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] snapshot: a8fcae95-e956-42d1-919b-5d015ee00c66, volume: 51cf9077-631c-4a14-9052-c8fd9b68e71d,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[db60768d-ce8a-4022-b38b-a052acc164f5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:44 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:44 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:44 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df2160a7-cf7d-485c-8a27-5799faec5869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c07c31-cf7f-4f93-bca7-e0609eff49b4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:44 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:49:44 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:45 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 0.748s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:45 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:49:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:45 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d
Jul 02 04:49:45 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:51 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d" returned: 0 in 5.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45cc95-07a4-45f1-a882-acd54f60ad4e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:51 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:49:51 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:51 devstack sudo[93322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:49:51 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=56,cinder:UPDATE=41,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=47,cinder:UPDATE=50,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:49:52 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.685s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:49:52 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 1.029s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:49:52 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Converted 1024.00 MB image at 172.31 MB/s
Jul 02 04:49:52 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d is being set with open permissions: ugo+rw
Jul 02 04:49:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:52 devstack sudo[93328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d
Jul 02 04:49:52 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:53 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d" returned: 0 in 0.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" released by "_copy_volume_from_snapshot" :: held 9.291s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-a8fcae95-e956-42d1-919b-5d015ee00c66" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-a8fcae95-e956-42d1-919b-5d015ee00c66" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Deleting offline snapshot a8fcae95-e956-42d1-919b-5d015ee00c66 of volume df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] snapshot_file for this snap is: volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd8d6b-4a12-4347-9cbb-ac29bccbbb10]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:53 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:53 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:54 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 0.801s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df2160a7-cf7d-485c-8a27-5799faec5869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c641f29-8092-4cda-9065-cea5df439e76]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:54 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:49:54 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:54 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 0.736s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:54 devstack sudo[93397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:54 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:55 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 0.701s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:55 devstack sudo[93402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66
Jul 02 04:49:55 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:56 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869.a8fcae95-e956-42d1-919b-5d015ee00c66" returned: 0 in 0.628s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-a8fcae95-e956-42d1-919b-5d015ee00c66" released by "_delete_snapshot" :: held 2.973s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.966s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.282s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ccc83c-7424-4568-9beb-22d2ac41aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cf9077-631c-4a14-9052-c8fd9b68e71d', 'volume_size': 1, 'source_volid': 'df2160a7-cf7d-485c-8a27-5799faec5869', 'source_volstatus': 'available'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f24c1-e08c-4c1a-8fae-5892c95fd6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb6da3-b818-459d-afaa-c734f13b1880]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Volume volume-51cf9077-631c-4a14-9052-c8fd9b68e71d (51cf9077-631c-4a14-9052-c8fd9b68e71d): created successfully
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907f24c1-e08c-4c1a-8fae-5892c95fd6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (0018a453-f35f-4b40-8e76-636eb986115d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-286f4a1d-0330-445a-ab3f-ae39b1a3411e tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:49:56 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279
Jul 02 04:49:56 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:57 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279" returned: 0 in 0.802s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.079s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11487bc-f80f-4f21-b4f4-7ea5320a85f4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-f9370cac-1540-47e0-8b54-5b5edea1e279', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3201cf1b-88bb-4454-bd92-d743d598f500', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:49:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-03c34c8f-5dcd-44d4-a0f1-7c52a554593c req-2cf4e3d2-5e1f-4b3e-8ed4-59c9e5c3c70a tempest-AttachVolumeNegativeTest-22984720 None] attachment_update completed successfully.
Jul 02 04:49:57 devstack sudo[93410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a
Jul 02 04:49:57 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:57 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" returned: 0 in 0.839s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86c12ae9-c01a-406c-876d-a1938329df6c', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:49:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-8757cc91-98e1-413b-9cf8-227a18b538e6 req-c50c3f76-7db8-4616-9f4c-42c92b882f9b tempest-ServerActionsTestOtherA-1062174158 None] attachment_update completed successfully.
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (a0d3948d-be91-4e7c-953a-dbd78da024dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c73f778-a530-47f4-a43e-7b8a80d3910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c73f778-a530-47f4-a43e-7b8a80d3910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1379701185',display_name='tempest-VolumesGetTest-Volume-1158540863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada72778-6440-4f51-b35f-7fec6d986dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:58Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd0e571-019c-45ed-ad0f-bf5d5608b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd0e571-019c-45ed-ad0f-bf5d5608b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62dd10b-3a22-49e9-8732-92234286e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62dd10b-3a22-49e9-8732-92234286e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada72778-6440-4f51-b35f-7fec6d986dd7', 'volume_name': 'volume-ada72778-6440-4f51-b35f-7fec6d986dd7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bf0f8f-e1f1-4908-9723-e524d80a2793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bf0f8f-e1f1-4908-9723-e524d80a2793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa51279-901d-4221-97f4-602bfe1e1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:49:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Volume ada72778-6440-4f51-b35f-7fec6d986dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada72778-6440-4f51-b35f-7fec6d986dd7', 'volume_size': 1}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:49:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1379701185',display_name='tempest-VolumesGetTest-Volume-1158540863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada72778-6440-4f51-b35f-7fec6d986dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:49:58Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Creating volume ada72778-6440-4f51-b35f-7fec6d986dd7 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:49:58 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:49:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:58 devstack sudo[93417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 1073741824
Jul 02 04:49:58 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:59 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 1073741824" returned: 0 in 0.842s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:49:59 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7
Jul 02 04:49:59 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:49:59 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Jul 02 04:49:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7" returned: 0 in 0.628s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:49:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:49:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa51279-901d-4221-97f4-602bfe1e1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada72778-6440-4f51-b35f-7fec6d986dd7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f2fe67-afa2-45e4-90ee-f882eda93405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:00 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Volume volume-ada72778-6440-4f51-b35f-7fec6d986dd7 (ada72778-6440-4f51-b35f-7fec6d986dd7): created successfully
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f2fe67-afa2-45e4-90ee-f882eda93405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (a0d3948d-be91-4e7c-953a-dbd78da024dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:00 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8ea520ec-93d8-4167-9d24-7aed3fc2d08a tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-ada72778-6440-4f51-b35f-7fec6d986dd7-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "cinder-ada72778-6440-4f51-b35f-7fec6d986dd7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-ada72778-6440-4f51-b35f-7fec6d986dd7" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-ada72778-6440-4f51-b35f-7fec6d986dd7" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[29935b91-2c99-4dfc-b506-04c88dae73bc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:00 devstack sudo[93444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7
Jul 02 04:50:00 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:01 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7" returned: 0 in 0.806s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:01 devstack sudo[93449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7
Jul 02 04:50:01 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:02 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ada72778-6440-4f51-b35f-7fec6d986dd7" returned: 0 in 0.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-ada72778-6440-4f51-b35f-7fec6d986dd7" released by "delete_volume" :: held 1.607s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Created reservations ['37bf2303-9655-4159-8253-cafd24a8cd57', 'dea7f39a-389e-4804-a332-04464d1ecda2', '97a4d42a-87ad-418e-abb4-6de5440a61a3', '8e51bafb-2691-408a-813d-000db015acbc'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:02 devstack sudo[93456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:02 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-51cf9077-631c-4a14-9052-c8fd9b68e71d-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "cinder-51cf9077-631c-4a14-9052-c8fd9b68e71d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c02385-5945-4714-a877-faf19a844c06]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:03 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d
Jul 02 04:50:03 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:03 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.763s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:50:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93a6a8d4-7187-444e-a419-297c4d0d2bc2 tempest-VolumesGetTest-1723212300 None] Lock "cinder-ada72778-6440-4f51-b35f-7fec6d986dd7-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-ed6db3ad-e8d0-479b-b255-3c6d3192b1b2 req-e1ac8fca-5586-4a80-abbb-dc919b88ad23 tempest-AttachVolumeNegativeTest-22984720 None] Terminate volume connection completed successfully.
Jul 02 04:50:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-ed6db3ad-e8d0-479b-b255-3c6d3192b1b2 req-e1ac8fca-5586-4a80-abbb-dc919b88ad23 tempest-AttachVolumeNegativeTest-22984720 None] Deleting attachment 3201cf1b-88bb-4454-bd92-d743d598f500. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:50:04 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d" returned: 0 in 1.267s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:04 devstack sudo[93515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d
Jul 02 04:50:04 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:05 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-51cf9077-631c-4a14-9052-c8fd9b68e71d" returned: 0 in 0.785s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-51cf9077-631c-4a14-9052-c8fd9b68e71d" released by "delete_volume" :: held 2.100s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Created reservations ['4d39f323-bb57-4360-85b5-213603212608', '1ff4b8d2-4c98-4967-a1e7-2ed47b29c640', 'b6e24b05-f4fa-4bf5-bd36-d470ee049a7d', '6da7f42a-3d6a-4aaa-a43d-6f3e6b27179a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:05 devstack sudo[93521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:05 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:06 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.105s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-df2160a7-cf7d-485c-8a27-5799faec5869-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-18b3d596-f6f7-4c41-94d4-430e2e0992cd tempest-VolumesGetTest-1723212300 None] Lock "cinder-51cf9077-631c-4a14-9052-c8fd9b68e71d-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "cinder-df2160a7-cf7d-485c-8a27-5799faec5869-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-df2160a7-cf7d-485c-8a27-5799faec5869" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-df2160a7-cf7d-485c-8a27-5799faec5869" acquired by "delete_volume" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd645859-b509-476b-9c6b-feb93e11111f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:07 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:50:07 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:08 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 1.520s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:08 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869
Jul 02 04:50:08 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:09 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-df2160a7-cf7d-485c-8a27-5799faec5869" returned: 0 in 0.920s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-df2160a7-cf7d-485c-8a27-5799faec5869" released by "delete_volume" :: held 2.591s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Created reservations ['8f6d05d6-7527-4866-9d4e-57a166135bb7', 'd20de100-fc37-45f1-a702-d850158deffd', '01f575d7-dd93-4863-9f63-a6bbefafdb24', '4ff3db5e-b247-4269-a7f2-f7e96f6b420d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:09 devstack sudo[93625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:09 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:10 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.136s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:10 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:50:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-351fd60e-fd0f-4786-b455-311bc46f65a1 tempest-VolumesGetTest-1723212300 None] Lock "cinder-df2160a7-cf7d-485c-8a27-5799faec5869-delete_volume" released by "delete_volume" :: held 4.066s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (af52df54-dbbf-4d78-884f-698d7244c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4e796-f5e2-4ee5-9c12-a50a0c468233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4e796-f5e2-4ee5-9c12-a50a0c468233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1198972787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8492ade-d530-4f42-9c60-3dee46151c54,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:11Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d54ba-7e38-4340-83ae-d8b45a5bc1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d54ba-7e38-4340-83ae-d8b45a5bc1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c16fbd-27f4-4783-a07b-61769d264072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c16fbd-27f4-4783-a07b-61769d264072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8492ade-d530-4f42-9c60-3dee46151c54', 'volume_name': 'volume-a8492ade-d530-4f42-9c60-3dee46151c54', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1d7b800>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a55b4a9-9624-4d70-a970-f2f2ab1f8fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a55b4a9-9624-4d70-a970-f2f2ab1f8fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d7067-61a4-4e60-ba6a-53dc48098973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Volume a8492ade-d530-4f42-9c60-3dee46151c54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8492ade-d530-4f42-9c60-3dee46151c54', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1d7b800>}
Jul 02 04:50:11 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Trying to clone a8492ade-d530-4f42-9c60-3dee46151c54 from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 04:50:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-f2af9a86-fc15-4796-b293-9804fb10b83e req-0545719d-d6e1-4e6a-88b6-1f8529ee84b2 tempest-TestShelveInstance-1392562446 None] Terminate volume connection completed successfully.
Jul 02 04:50:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-f2af9a86-fc15-4796-b293-9804fb10b83e req-0545719d-d6e1-4e6a-88b6-1f8529ee84b2 tempest-TestShelveInstance-1392562446 None] Deleting attachment f9f18dbb-a27c-437b-a041-11e1d0c2a68f. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:50:12 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 04:50:12 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 04:50:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a35675-13f8-41b8-a34e-fe6c73305a19]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:12 devstack sudo[93635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD
Jul 02 04:50:12 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:13 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:13 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 is fetched for user 76c96f4399894faa888e70df13318f35. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 04:50:13 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c655e1-3695-4efe-98b2-8ac16e9300d1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:13 devstack sudo[93640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD
Jul 02 04:50:13 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:14 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD" returned: 0 in 0.956s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1198972787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8492ade-d530-4f42-9c60-3dee46151c54,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:11Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Creating volume a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:50:14 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:50:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:14 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1073741824
Jul 02 04:50:14 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:15 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1073741824" returned: 0 in 1.406s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:15 devstack sudo[93655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:15 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:16 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 0 in 0.678s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Attempting download of 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume a8492ade-d530-4f42-9c60-3dee46151c54. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd887fb6-001a-4524-83a6-833912704234]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:16 devstack sudo[93659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51
Jul 02 04:50:16 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:17 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51" returned: 0 in 0.917s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc56b4-505f-4749-b956-a90eea8b852c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:17 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51
Jul 02 04:50:17 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:17 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:50:17 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:18 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51" returned: 1 in 0.927s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_hrwtnb51' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d91634b-d814-4fb5-9de1-b2e332acc06c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:18 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD
Jul 02 04:50:18 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:18 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 1.159s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:18 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:50:18 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:19 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD" returned: 0 in 0.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] 3cdb7750-2f67-439d-ab9d-6580dacde6f8 was qcow2, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:19 devstack sudo[93725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:19 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:19 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 1 in 0.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.124s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-ffe64cb7-b8a2-47c8-8960-24507df90516', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da00994b-4870-4d83-b129-24fc26e0e575', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:50:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-daa41250-d57d-498e-9063-1e2be687271f req-b3df1f4a-2ffc-4690-a9c9-e07c1a0a78db tempest-TestShelveInstance-1392562446 None] attachment_update completed successfully.
Jul 02 04:50:21 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 0 in 1.967s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:21 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_zazziy7gdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:50:21 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Converted 112.00 MB image at 56.91 MB/s
Jul 02 04:50:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:21 devstack sudo[93746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1G
Jul 02 04:50:21 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:22 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 1G" returned: 0 in 0.714s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:22 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b1a88-7bb7-4504-9e58-ad3b2e882519]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:22 devstack sudo[93751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:22 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:22 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 0 in 0.751s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:22 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:22 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:23 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 1 in 0.800s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Downloaded image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume a8492ade-d530-4f42-9c60-3dee46151c54 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 for user 76c96f4399894faa888e70df13318f35 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Marking volume a8492ade-d530-4f42-9c60-3dee46151c54 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Copying metadata from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 to a8492ade-d530-4f42-9c60-3dee46151c54. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Creating volume glance metadata for volume a8492ade-d530-4f42-9c60-3dee46151c54 backed by image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205d7067-61a4-4e60-ba6a-53dc48098973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8492ade-d530-4f42-9c60-3dee46151c54', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1d7b800>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc85486-9279-4b29-b80f-b51c0eb68a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Volume volume-a8492ade-d530-4f42-9c60-3dee46151c54 (a8492ade-d530-4f42-9c60-3dee46151c54): created successfully
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc85486-9279-4b29-b80f-b51c0eb68a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (af52df54-dbbf-4d78-884f-698d7244c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:23 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c9487ab1-23a7-4bba-ba27-d673c006900b tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (ed082470-5bbe-4e03-887e-6b395bd5585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc5b5ae-ea46-4aa9-90df-a843b39036ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc5b5ae-ea46-4aa9-90df-a843b39036ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-153044037',display_name='tempest-VolumesGetTest-Volume-1423839722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c014ec-689f-477f-871b-e0564288f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:25Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0105b6f7-d1bf-4932-add6-a531a2808da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0105b6f7-d1bf-4932-add6-a531a2808da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0662d0-276d-456b-b83f-c3835d3fcd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0662d0-276d-456b-b83f-c3835d3fcd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c014ec-689f-477f-871b-e0564288f8f1', 'volume_name': 'volume-03c014ec-689f-477f-871b-e0564288f8f1', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4d61a-18f6-43e9-8785-711a9d3edee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4d61a-18f6-43e9-8785-711a9d3edee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf2aa0-e34d-4128-ad64-b93b05d4aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:25 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Volume 03c014ec-689f-477f-871b-e0564288f8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c014ec-689f-477f-871b-e0564288f8f1', 'volume_size': 1}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-153044037',display_name='tempest-VolumesGetTest-Volume-1423839722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c014ec-689f-477f-871b-e0564288f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e974a598934b85af1757d1533f3e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:25Z,use_quota=True,user_id='76c96f4399894faa888e70df13318f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Creating volume 03c014ec-689f-477f-871b-e0564288f8f1 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:50:25 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:50:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:25 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 1073741824
Jul 02 04:50:25 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:26 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 1073741824" returned: 0 in 1.190s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:26 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1
Jul 02 04:50:26 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:27 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1" returned: 0 in 0.720s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf2aa0-e34d-4128-ad64-b93b05d4aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c014ec-689f-477f-871b-e0564288f8f1', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0618b130-a1e2-43b0-b9f8-8ed778117300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Volume volume-03c014ec-689f-477f-871b-e0564288f8f1 (03c014ec-689f-477f-871b-e0564288f8f1): created successfully
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0618b130-a1e2-43b0-b9f8-8ed778117300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Flow 'volume_create_manager' (ed082470-5bbe-4e03-887e-6b395bd5585d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-41804472-2cdb-41c2-ad8a-4901e397da09 tempest-VolumesGetTest-1723212300 None] Created volume successfully.
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-03c014ec-689f-477f-871b-e0564288f8f1-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "cinder-03c014ec-689f-477f-871b-e0564288f8f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-03c014ec-689f-477f-871b-e0564288f8f1" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-03c014ec-689f-477f-871b-e0564288f8f1" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96381919-98dc-4a8f-bb44-bf1a2580fb65]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:28 devstack sudo[93790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1
Jul 02 04:50:28 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:29 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1" returned: 0 in 0.768s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:29 devstack sudo[93799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1
Jul 02 04:50:29 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-827efec1-e9cf-4068-b9ad-fb9b18f9c39f req-cb1b4f88-3ee5-4b38-93ef-06ce0f239308 tempest-ServerActionsTestOtherA-1062174158 None] Terminate volume connection completed successfully.
Jul 02 04:50:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-827efec1-e9cf-4068-b9ad-fb9b18f9c39f req-cb1b4f88-3ee5-4b38-93ef-06ce0f239308 tempest-ServerActionsTestOtherA-1062174158 None] Deleting attachment 86c12ae9-c01a-406c-876d-a1938329df6c. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:50:30 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-03c014ec-689f-477f-871b-e0564288f8f1" returned: 0 in 0.762s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-03c014ec-689f-477f-871b-e0564288f8f1" released by "delete_volume" :: held 1.585s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Created reservations ['483cd0fd-90fe-4f8a-a122-cbdd356385f9', '19240050-e3e3-4493-b817-d5a272cc7b8e', 'd9d6adcb-8e06-4c55-aff3-c9d7750e418e', '8f6bcb65-4dd0-42b6-95a7-db22313fba58'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:30 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:30 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-a8492ade-d530-4f42-9c60-3dee46151c54-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "cinder-a8492ade-d530-4f42-9c60-3dee46151c54-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Acquiring lock "cinder-quobyte-a8492ade-d530-4f42-9c60-3dee46151c54" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-a8492ade-d530-4f42-9c60-3dee46151c54" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[04666b50-103e-4c32-b2a7-5f3df63ceb3c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:31 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.188s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:50:31 devstack sudo[93870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:31 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-594fa818-5d14-427c-a7ea-502d4665ec52 tempest-VolumesGetTest-1723212300 None] Lock "cinder-03c014ec-689f-477f-871b-e0564288f8f1-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:32 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 0 in 1.375s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:32 devstack sudo[93916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:32 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:34 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 1 in 1.412s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:50:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:34 devstack sudo[93952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54
Jul 02 04:50:34 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:35 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a8492ade-d530-4f42-9c60-3dee46151c54" returned: 0 in 1.133s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "cinder-quobyte-a8492ade-d530-4f42-9c60-3dee46151c54" released by "delete_volume" :: held 4.034s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Created reservations ['b6b2956b-7659-4cfd-a566-310773aa999b', '807a0f05-e326-4642-8b21-68c482b27eb0', 'd892baba-25e4-43aa-a63e-f8d95ab0dd07', 'dcb477dd-6f79-4e71-944b-c87ee0aba990'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:35 devstack sudo[93957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:35 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-daa41250-d57d-498e-9063-1e2be687271f req-478d3a43-341f-4099-b285-bec4065a4ffb tempest-TestShelveInstance-1392562446 None] Terminate volume connection completed successfully.
Jul 02 04:50:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-daa41250-d57d-498e-9063-1e2be687271f req-478d3a43-341f-4099-b285-bec4065a4ffb tempest-TestShelveInstance-1392562446 None] Deleting attachment da00994b-4870-4d83-b129-24fc26e0e575. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:50:36 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.116s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:36 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Deleted volume successfully.
Jul 02 04:50:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b7ce5aad-8014-4642-8425-4575b4496039 tempest-VolumesGetTest-1723212300 None] Lock "cinder-a8492ade-d530-4f42-9c60-3dee46151c54-delete_volume" released by "delete_volume" :: held 5.453s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Flow 'volume_create_manager' (7f12234c-e9df-4214-bed2-c56e21d2e4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f27f4-f910-44d1-aee4-367400ec57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5f27f4-f910-44d1-aee4-367400ec57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1021840435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b7798e-7b4e-455d-b01f-854f5975aa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b920b88b6d0e4a1a90685f11de814b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:40Z,use_quota=True,user_id='7ddc67fa9cf54655aa2e3382691bc301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b352691d-a5e4-4f2f-b8e4-436b1d44d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b352691d-a5e4-4f2f-b8e4-436b1d44d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc5a128-8ffa-4871-992a-dc52a8aea588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc5a128-8ffa-4871-992a-dc52a8aea588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b7798e-7b4e-455d-b01f-854f5975aa5a', 'volume_name': 'volume-60b7798e-7b4e-455d-b01f-854f5975aa5a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42aaa11-7272-4b97-bddc-19e2a8a17146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42aaa11-7272-4b97-bddc-19e2a8a17146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6390dd2d-5311-479b-a59a-82cbdd253618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Volume 60b7798e-7b4e-455d-b01f-854f5975aa5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b7798e-7b4e-455d-b01f-854f5975aa5a', 'volume_size': 1}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1021840435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b7798e-7b4e-455d-b01f-854f5975aa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b920b88b6d0e4a1a90685f11de814b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:40Z,use_quota=True,user_id='7ddc67fa9cf54655aa2e3382691bc301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Creating volume 60b7798e-7b4e-455d-b01f-854f5975aa5a {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:50:39 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:50:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:39 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a 1073741824
Jul 02 04:50:39 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:40 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a 1073741824" returned: 0 in 1.047s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:40 devstack sudo[94007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a
Jul 02 04:50:40 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "cinder-fc7a5d1d-272b-46d1-b060-32d0b9d1407a-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "cinder-fc7a5d1d-272b-46d1-b060-32d0b9d1407a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "cinder-quobyte-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "cinder-quobyte-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eafab15-7610-44f9-a5c2-86d6cd6efa31]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:41 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a
Jul 02 04:50:41 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:41 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a" returned: 0 in 0.721s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6390dd2d-5311-479b-a59a-82cbdd253618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b7798e-7b4e-455d-b01f-854f5975aa5a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c04369c-485a-4997-8cee-eb958e0bbbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:41 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Volume volume-60b7798e-7b4e-455d-b01f-854f5975aa5a (60b7798e-7b4e-455d-b01f-854f5975aa5a): created successfully
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c04369c-485a-4997-8cee-eb958e0bbbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Flow 'volume_create_manager' (7f12234c-e9df-4214-bed2-c56e21d2e4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8941becc-e2ef-40e8-bcf9-f7b97cb85d17 tempest-VolumesNegativeTest-150488072 None] Created volume successfully.
Jul 02 04:50:41 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" returned: 0 in 0.811s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:41 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a
Jul 02 04:50:41 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:42 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" returned: 0 in 0.718s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "cinder-quobyte-fc7a5d1d-272b-46d1-b060-32d0b9d1407a" released by "delete_volume" :: held 1.577s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Created reservations ['b3513ff4-e6b4-4e2e-b7e6-4f3285eb74c0', 'd977ca90-8cc0-42a2-931f-5656c8f287aa', 'aa8ae821-9135-404c-8584-2d84502bdde7', 'e85c209f-1a65-49cf-909d-f958a18dc1ba'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:42 devstack sudo[94026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:42 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:43 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.784s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:43 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Deleted volume successfully.
Jul 02 04:50:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a079db00-f831-4f8c-aca4-36d8f284f325 tempest-ServerActionsTestOtherA-1062174158 None] Lock "cinder-fc7a5d1d-272b-46d1-b060-32d0b9d1407a-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:51 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:50:51 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:52 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.893s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:50:52 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=67,cinder:SELECT=68,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:50:53 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=73,cinder:SELECT=63,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (2ec0e610-7a01-419a-9204-5250db8ef780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e01fd0-c86e-4048-a9c3-cc82f522b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e01fd0-c86e-4048-a9c3-cc82f522b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2028672498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62de1b19-de19-440f-a0d1-4e4e5a7bb34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:58Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c805c064-a31d-4877-94b2-0f7f53aa4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c805c064-a31d-4877-94b2-0f7f53aa4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91be18b-9076-4f8c-8261-75cd14852557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91be18b-9076-4f8c-8261-75cd14852557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62de1b19-de19-440f-a0d1-4e4e5a7bb34e', 'volume_name': 'volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedae3f9-0b19-4f13-af0a-69cd627c05d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedae3f9-0b19-4f13-af0a-69cd627c05d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0986a3-cb10-48a6-a60b-b073d8f67a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:50:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Volume 62de1b19-de19-440f-a0d1-4e4e5a7bb34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e', 'volume_size': 1}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2028672498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62de1b19-de19-440f-a0d1-4e4e5a7bb34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f6cdaf87654c2a82690c70bc1fa37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:50:58Z,use_quota=True,user_id='781f5a064af74a0eb06b73aa73286c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Creating volume 62de1b19-de19-440f-a0d1-4e4e5a7bb34e {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:50:58 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:50:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:58 devstack sudo[94202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e 1073741824
Jul 02 04:50:58 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:50:59 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root
Jul 02 04:50:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e 1073741824" returned: 0 in 1.171s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:50:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:50:59 devstack sudo[94210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e
Jul 02 04:50:59 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:00 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" returned: 0 in 1.222s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:51:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.485s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0986a3-cb10-48a6-a60b-b073d8f67a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea99ed4-7ad2-4c42-bff9-89618a5f8c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:01 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Volume volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e (62de1b19-de19-440f-a0d1-4e4e5a7bb34e): created successfully
Jul 02 04:51:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea99ed4-7ad2-4c42-bff9-89618a5f8c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Flow 'volume_create_manager' (2ec0e610-7a01-419a-9204-5250db8ef780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-499c6b32-7d9b-4c6f-84bf-1d09416eb208 tempest-AttachVolumeNegativeTest-22984720 None] Created volume successfully.
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7cbdc-63e1-4e43-be9d-9f7656b9fc4f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:05 devstack sudo[94270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e
Jul 02 04:51:05 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:05 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" returned: 0 in 0.883s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9aade919-32a2-45db-a99e-f874db4fe344', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:51:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-438a098a-1268-4ad6-b361-00f2ef519d0a req-8fb451d9-e238-408a-ae1f-4fca824df8a5 tempest-AttachVolumeNegativeTest-22984720 None] attachment_update completed successfully.
Jul 02 04:51:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-966faa71-47a7-4e06-8689-d6876c06bb39 req-10c324cf-4841-4de8-982a-6140e784be55 tempest-AttachVolumeNegativeTest-22984720 None] Terminate volume connection completed successfully.
Jul 02 04:51:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-966faa71-47a7-4e06-8689-d6876c06bb39 req-10c324cf-4841-4de8-982a-6140e784be55 tempest-AttachVolumeNegativeTest-22984720 None] Deleting attachment 9aade919-32a2-45db-a99e-f874db4fe344. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Acquiring lock "cinder-60b7798e-7b4e-455d-b01f-854f5975aa5a-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "cinder-60b7798e-7b4e-455d-b01f-854f5975aa5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Acquiring lock "cinder-quobyte-60b7798e-7b4e-455d-b01f-854f5975aa5a" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "cinder-quobyte-60b7798e-7b4e-455d-b01f-854f5975aa5a" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc7690-750c-4fdc-b410-66d7ebee4dac]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:14 devstack sudo[94698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a
Jul 02 04:51:14 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:15 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a" returned: 0 in 0.762s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:15 devstack sudo[94704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a
Jul 02 04:51:15 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:16 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60b7798e-7b4e-455d-b01f-854f5975aa5a" returned: 0 in 0.737s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "cinder-quobyte-60b7798e-7b4e-455d-b01f-854f5975aa5a" released by "delete_volume" :: held 1.544s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Created reservations ['b02ed616-6e12-465e-b263-dee687406e5f', '7522f181-2aa7-4584-b1d2-5eb90390b1b3', '27f32018-a428-4b55-95e4-62235ec85263', '3f191424-0ace-4dd5-bcbe-a8a9650d3481'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:16 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:16 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:17 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.016s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:17 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:17 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Deleted volume successfully.
Jul 02 04:51:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7effe289-2f0a-4912-8391-862870c7b563 tempest-VolumesNegativeTest-150488072 None] Lock "cinder-60b7798e-7b4e-455d-b01f-854f5975aa5a-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-62de1b19-de19-440f-a0d1-4e4e5a7bb34e-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-62de1b19-de19-440f-a0d1-4e4e5a7bb34e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-quobyte-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77e60af-95d6-475c-95c2-42160cd4e841]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:26 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e
Jul 02 04:51:26 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:27 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" returned: 0 in 1.171s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:27 devstack sudo[94865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e
Jul 02 04:51:27 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:27 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:51:28 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" returned: 0 in 1.262s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-62de1b19-de19-440f-a0d1-4e4e5a7bb34e" released by "delete_volume" :: held 2.507s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:28 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Created reservations ['dcc081c0-2937-435d-809e-d16b363eb61d', 'ff0928c9-d8c1-4f98-a688-7bb435ccd26a', '5a782da1-5848-41bc-80dc-2238007270b7', '54b18e90-c172-46ea-afe3-be2074a174a1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:29 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:29 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:30 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.115s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:30 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Deleted volume successfully.
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-476e11d6-bc33-46f1-b797-8cb9bb85f3f6 tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-62de1b19-de19-440f-a0d1-4e4e5a7bb34e-delete_volume" released by "delete_volume" :: held 4.219s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-f9370cac-1540-47e0-8b54-5b5edea1e279-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-f9370cac-1540-47e0-8b54-5b5edea1e279-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-quobyte-f9370cac-1540-47e0-8b54-5b5edea1e279" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-f9370cac-1540-47e0-8b54-5b5edea1e279" acquired by "delete_volume" :: waited 0.045s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94aa89b-0e12-4e54-9494-41af3afcb812]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:31 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279
Jul 02 04:51:31 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:32 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279" returned: 0 in 1.589s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:32 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279
Jul 02 04:51:32 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:34 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f9370cac-1540-47e0-8b54-5b5edea1e279" returned: 0 in 1.641s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-f9370cac-1540-47e0-8b54-5b5edea1e279" released by "delete_volume" :: held 3.324s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Created reservations ['51e86543-252f-4e06-ab6e-5308cce5ae96', 'edf6dafc-a433-43a1-9c2d-ea89141a77d9', '25911d81-1215-4e22-bf43-4eed5f5da2e9', 'fa8a1feb-5a42-4f4d-a3fd-8fa3e7fb27eb'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:34 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:34 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:35 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-3d5d02c7-0fd8-4c9d-b038-d62c5266832a-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.323s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Deleted volume successfully.
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-3d5d02c7-0fd8-4c9d-b038-d62c5266832a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eafcc09c-a99a-4698-863d-fd47aedfc80c tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-f9370cac-1540-47e0-8b54-5b5edea1e279-delete_volume" released by "delete_volume" :: held 5.325s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "cinder-quobyte-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e489d7a-fcea-4825-a920-7c7643e4a51b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:36 devstack sudo[94932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a
Jul 02 04:51:36 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:36 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:51:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (88f15079-8472-4165-9783-d657d1dad5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249c8aa2-a51c-411d-b0e0-6dafa0cee46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249c8aa2-a51c-411d-b0e0-6dafa0cee46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478317451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867ad7f2-7355-4be1-b81b-a7b0dd2a80d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:37Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df33f240-39f0-4d22-94fc-f7519de56d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df33f240-39f0-4d22-94fc-f7519de56d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa9b1f9-f557-477a-864b-24a53ada1594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa9b1f9-f557-477a-864b-24a53ada1594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867ad7f2-7355-4be1-b81b-a7b0dd2a80d3', 'volume_name': 'volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f13e46-50d4-4779-944a-fb516b0e4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f13e46-50d4-4779-944a-fb516b0e4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10abd2bf-bc75-42db-a779-d80163687d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Volume 867ad7f2-7355-4be1-b81b-a7b0dd2a80d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3', 'volume_size': 1}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478317451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867ad7f2-7355-4be1-b81b-a7b0dd2a80d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:37Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Creating volume 867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:51:37 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:37 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 1073741824
Jul 02 04:51:37 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:37 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" returned: 0 in 1.453s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:37 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a
Jul 02 04:51:37 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:38 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 1073741824" returned: 0 in 1.165s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:38 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3
Jul 02 04:51:38 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:38 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" returned: 0 in 0.960s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-quobyte-3d5d02c7-0fd8-4c9d-b038-d62c5266832a" released by "delete_volume" :: held 2.485s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Created reservations ['06d8010a-e952-4e1c-bd67-6ae9f0ab09fb', '478419a5-f512-43c8-a08d-db4eeaa62341', '82682e93-5c08-4633-ba87-319afe47c382', '1686ecd1-8d30-4c58-b3b5-69d2d4dd9fda'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:38 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:38 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:39 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" returned: 0 in 1.255s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] <== create_volume: return (2500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.503s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10abd2bf-bc75-42db-a779-d80163687d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17e955-32c8-4b2c-b795-e51ea27725a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Volume volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 (867ad7f2-7355-4be1-b81b-a7b0dd2a80d3): created successfully
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb17e955-32c8-4b2c-b795-e51ea27725a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (88f15079-8472-4165-9783-d657d1dad5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e8e047d8-2476-44a1-a690-b77d29592af1 tempest-VolumesSnapshotTestJSON-385717898 None] Created volume successfully.
Jul 02 04:51:40 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.493s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Deleted volume successfully.
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-56107756-c984-42f1-befa-8d49990ba9cb tempest-AttachVolumeNegativeTest-22984720 None] Lock "cinder-3d5d02c7-0fd8-4c9d-b038-d62c5266832a-delete_volume" released by "delete_volume" :: held 4.447s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Creating offline snapshot 6ce83d90-9126-496a-b2de-4e6de2154e11 of volume 867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5520f9-ef57-435c-8641-67ce4dc93018]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:41 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3
Jul 02 04:51:41 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:41 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" returned: 0 in 0.963s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:41 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 1G
Jul 02 04:51:41 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:42 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 1G" returned: 0 in 0.984s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:42 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11
Jul 02 04:51:42 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:43 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11" returned: 0 in 0.805s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:43 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 is being set with open permissions: ugo+rw
Jul 02 04:51:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:43 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11
Jul 02 04:51:43 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:44 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11" returned: 0 in 0.808s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:44 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info
Jul 02 04:51:44 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:45 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info" returned: 0 in 0.883s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:45 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info is being set with open permissions: ugo+rw
Jul 02 04:51:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:45 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info
Jul 02 04:51:45 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:46 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.info" returned: 0 in 1.028s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.641s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:46 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ad0c391c-8281-4f73-a213-bbc86a524a28 tempest-VolumesSnapshotTestJSON-385717898 None] Create snapshot completed successfully
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-6ce83d90-9126-496a-b2de-4e6de2154e11-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-6ce83d90-9126-496a-b2de-4e6de2154e11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-6ce83d90-9126-496a-b2de-4e6de2154e11" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-6ce83d90-9126-496a-b2de-4e6de2154e11" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Deleting offline snapshot 6ce83d90-9126-496a-b2de-4e6de2154e11 of volume 867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] snapshot_file for this snap is: volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b4bde-cb2c-4270-8e1e-6efa4c3fe0e1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:47 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11
Jul 02 04:51:47 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:48 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11" returned: 0 in 1.137s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae4761-cc37-4137-aa72-4cf40abbd477]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Flow 'volume_create_manager' (3b33fd23-a13b-4481-8487-9ebb36cc040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4e7447-0d74-4681-a44d-b79bed8534a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4e7447-0d74-4681-a44d-b79bed8534a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-250410214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f34daa-f212-4ffc-8323-7a69c569bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0fa581737f949138f9ee64c67f09fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:49Z,use_quota=True,user_id='a2a5d59eed0047b2b7a1a011f0d9d63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4ac0e9-c33d-4900-b7b1-a3758cc0e481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4ac0e9-c33d-4900-b7b1-a3758cc0e481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e9af31-c2ec-4cc5-917e-fc13f9d20dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e9af31-c2ec-4cc5-917e-fc13f9d20dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f34daa-f212-4ffc-8323-7a69c569bd55', 'volume_name': 'volume-21f34daa-f212-4ffc-8323-7a69c569bd55', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90beaaaa-9f71-4299-adaa-44083a662047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90beaaaa-9f71-4299-adaa-44083a662047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5535abb3-7d4a-4c54-a5c1-7b35da44e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:48 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Volume 21f34daa-f212-4ffc-8323-7a69c569bd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f34daa-f212-4ffc-8323-7a69c569bd55', 'volume_size': 1}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-250410214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f34daa-f212-4ffc-8323-7a69c569bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0fa581737f949138f9ee64c67f09fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:49Z,use_quota=True,user_id='a2a5d59eed0047b2b7a1a011f0d9d63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Creating volume 21f34daa-f212-4ffc-8323-7a69c569bd55 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:51:48 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:51:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:49 devstack sudo[95150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 1073741824
Jul 02 04:51:49 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:49 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3
Jul 02 04:51:49 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:49 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" returned: 0 in 1.109s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:49 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11
Jul 02 04:51:49 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Flow 'volume_create_manager' (aaf40a94-4e40-4ee4-82b2-fdbebc266c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed74a64d-0ca4-41bf-89a0-bcc24879b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed74a64d-0ca4-41bf-89a0-bcc24879b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-374208485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310c9a2d-b155-411f-ab73-4e4d1916872e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd717c4884544452aee21298132a301a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:50Z,use_quota=True,user_id='affd795b9676402cb156131c29af24b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f4bffc-3867-4a30-b5fe-b7bd986a3c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f4bffc-3867-4a30-b5fe-b7bd986a3c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88246fb-81b0-48d7-92e8-04608cf8ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88246fb-81b0-48d7-92e8-04608cf8ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310c9a2d-b155-411f-ab73-4e4d1916872e', 'volume_name': 'volume-310c9a2d-b155-411f-ab73-4e4d1916872e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c82eaba-a8cc-411d-9391-247331b90a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c82eaba-a8cc-411d-9391-247331b90a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac17927-294f-4700-a406-2e137716006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Volume 310c9a2d-b155-411f-ab73-4e4d1916872e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310c9a2d-b155-411f-ab73-4e4d1916872e', 'volume_size': 1}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:50 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 1073741824" returned: 0 in 1.170s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:50 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55
Jul 02 04:51:50 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:50 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11" returned: 0 in 0.888s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:50 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55" returned: 0 in 0.684s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-374208485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310c9a2d-b155-411f-ab73-4e4d1916872e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd717c4884544452aee21298132a301a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:50Z,use_quota=True,user_id='affd795b9676402cb156131c29af24b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Creating volume 310c9a2d-b155-411f-ab73-4e4d1916872e {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:50 devstack sudo[95169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11
Jul 02 04:51:50 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:51:50 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:50 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e 1073741824
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5535abb3-7d4a-4c54-a5c1-7b35da44e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f34daa-f212-4ffc-8323-7a69c569bd55', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5dafd8-7d56-4abb-a91b-c82dac712405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:50 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Volume volume-21f34daa-f212-4ffc-8323-7a69c569bd55 (21f34daa-f212-4ffc-8323-7a69c569bd55): created successfully
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5dafd8-7d56-4abb-a91b-c82dac712405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Flow 'volume_create_manager' (3b33fd23-a13b-4481-8487-9ebb36cc040d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:50 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-680ceacd-4d5f-457b-8c80-3afbe705a6c0 tempest-ServerRescueNegativeTestJSON-1812166147 None] Created volume successfully.
Jul 02 04:51:51 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3.6ce83d90-9126-496a-b2de-4e6de2154e11" returned: 0 in 0.661s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-6ce83d90-9126-496a-b2de-4e6de2154e11" released by "_delete_snapshot" :: held 3.964s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" released by "delete_snapshot" :: held 3.992s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['064edbb6-c2f1-4fbf-8174-1785fb5d14b1', '70d34f64-a26e-451a-b1cb-6ca014ba2a55', '741a4aa4-f44f-49ac-b451-28c13e344716', '5f68c62b-e46d-449d-b5e1-2674ae98d568'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Delete snapshot completed successfully.
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2245a0af-d616-40f8-b066-21f62d3c6fda tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-6ce83d90-9126-496a-b2de-4e6de2154e11-delete_snapshot" released by "delete_snapshot" :: held 4.244s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:51 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e 1073741824" returned: 0 in 0.991s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:51 devstack sudo[95178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:51 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:52 devstack sudo[95180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e
Jul 02 04:51:52 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:53 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.215s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:51:53 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (e6b80a1a-83b7-4171-b0f1-77af1354d8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6534dc-eb9a-41bd-a55d-79b758a7a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e" returned: 0 in 1.124s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6534dc-eb9a-41bd-a55d-79b758a7a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1024569097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80e1b67-11cc-4b2e-bf8c-03d350dbb06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:53Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e964f31-2793-4ca8-8b7d-5171a197325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e964f31-2793-4ca8-8b7d-5171a197325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e9247e-4fd4-4a28-a2cd-ad81cde16d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e9247e-4fd4-4a28-a2cd-ad81cde16d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80e1b67-11cc-4b2e-bf8c-03d350dbb06f', 'volume_name': 'volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436c506-4a4d-41f5-a974-826ce72763ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4436c506-4a4d-41f5-a974-826ce72763ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840f8ae-5391-4dfc-9ec7-c9b866628a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Volume a80e1b67-11cc-4b2e-bf8c-03d350dbb06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f', 'volume_size': 1}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1024569097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80e1b67-11cc-4b2e-bf8c-03d350dbb06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:51:53Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Creating volume a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:51:53 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac17927-294f-4700-a406-2e137716006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310c9a2d-b155-411f-ab73-4e4d1916872e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e4e589-5d1f-40fb-9082-2ec5326d85b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:53 devstack sudo[95185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f 1073741824
Jul 02 04:51:53 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Volume volume-310c9a2d-b155-411f-ab73-4e4d1916872e (310c9a2d-b155-411f-ab73-4e4d1916872e): created successfully
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e4e589-5d1f-40fb-9082-2ec5326d85b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Flow 'volume_create_manager' (aaf40a94-4e40-4ee4-82b2-fdbebc266c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-884d8316-53b1-4962-8708-3f3ff1b8966c req-260934cd-2bfa-4a1d-9db5-87a786cbc958 tempest-VolumesGetTestJSON-1263759168 None] Created volume successfully.
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Acquiring lock "cinder-310c9a2d-b155-411f-ab73-4e4d1916872e-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "cinder-310c9a2d-b155-411f-ab73-4e4d1916872e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=55,cinder:INSERT=14,cinder:SELECT=56,cinder:DELETE=2 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Acquiring lock "cinder-quobyte-310c9a2d-b155-411f-ab73-4e4d1916872e" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "cinder-quobyte-310c9a2d-b155-411f-ab73-4e4d1916872e" acquired by "delete_volume" :: waited 0.056s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387b1a0-e805-4538-8db2-e68b07e01ffc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:54 devstack sudo[95191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e
Jul 02 04:51:54 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:54 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f 1073741824" returned: 0 in 1.117s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:54 devstack sudo[95193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:51:54 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:54 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e" returned: 0 in 0.919s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:54 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e
Jul 02 04:51:54 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:55 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 0.762s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840f8ae-5391-4dfc-9ec7-c9b866628a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02348f1f-7525-4000-b8ef-5df9c29653c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:51:55 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Volume volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f (a80e1b67-11cc-4b2e-bf8c-03d350dbb06f): created successfully
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02348f1f-7525-4000-b8ef-5df9c29653c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (e6b80a1a-83b7-4171-b0f1-77af1354d8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:51:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-083361e9-f388-4e4e-99d8-8ce6e9b87d16 tempest-VolumesSnapshotTestJSON-385717898 None] Created volume successfully.
Jul 02 04:51:55 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-310c9a2d-b155-411f-ab73-4e4d1916872e" returned: 0 in 0.755s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "cinder-quobyte-310c9a2d-b155-411f-ab73-4e4d1916872e" released by "delete_volume" :: held 1.727s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.quota [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Created reservations ['219572e1-03a1-4a90-aef1-2c3457918843', '1dce8b45-9339-4564-96af-512df6bc0e98', 'e2b20813-f3fb-44b5-a168-0b0f86ede88d', 'd10546bf-5aab-47d2-99fc-4af3bb7c1336'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:51:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:55 devstack sudo[95202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:51:55 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:57 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.266s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG cinder.manager [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:51:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Deleted volume successfully.
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Creating offline snapshot ded3743f-3145-4271-88ed-f35cc0549517 of volume a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-6756dd28-4f31-4099-9cdf-db87ebbe220e req-d541f60d-22e1-42e1-b845-a1e5706ee2da tempest-VolumesGetTestJSON-1263759168 None] Lock "cinder-310c9a2d-b155-411f-ab73-4e4d1916872e-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f89a07-8c9f-404b-b951-57cc68530828]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:51:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:57 devstack sudo[95248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:51:57 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:58 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 1.261s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:58 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 1G
Jul 02 04:51:58 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:51:59 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Jul 02 04:51:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 1G" returned: 0 in 1.228s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:51:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:51:59 devstack sudo[95311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:51:59 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:00 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.808s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:00 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 is being set with open permissions: ugo+rw
Jul 02 04:52:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:00 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:52:00 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:01 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.685s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:01 devstack sudo[95322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info
Jul 02 04:52:01 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:02 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info" returned: 0 in 0.885s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:02 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info is being set with open permissions: ugo+rw
Jul 02 04:52:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:02 devstack sudo[95359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info
Jul 02 04:52:02 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a7f9cc53-feb0-4ce3-a6e0-14442a539c17 tempest-GroupSnapshotsV319Test-1653105811 None] Group tempest-GroupSnapshotsV319Test-Group-2111919034: creating
Jul 02 04:52:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a7f9cc53-feb0-4ce3-a6e0-14442a539c17 tempest-GroupSnapshotsV319Test-1653105811 None] Group tempest-GroupSnapshotsV319Test-Group-2111919034: created successfully
Jul 02 04:52:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a7f9cc53-feb0-4ce3-a6e0-14442a539c17 tempest-GroupSnapshotsV319Test-1653105811 None] Create group completed successfully.
Jul 02 04:52:03 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.info" returned: 0 in 0.949s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.980s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0b49984a-98de-4ab3-940a-b6a90678c94b tempest-VolumesSnapshotTestJSON-385717898 None] Create snapshot completed successfully
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (39ac4d63-531a-472b-bd1c-2004fade577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cfd6c3-a41b-4558-b3e8-38d74f3f5f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cfd6c3-a41b-4558-b3e8-38d74f3f5f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1655707261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5450701a-1d85-4dae-8759-011992783a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ded3743f-3145-4271-88ed-f35cc0549517,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:04Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49688b9d-ae39-4eb5-9ae2-5f6562708e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49688b9d-ae39-4eb5-9ae2-5f6562708e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab3827b-8dd2-44a7-9211-c434f5906050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab3827b-8dd2-44a7-9211-c434f5906050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5450701a-1d85-4dae-8759-011992783a15', 'volume_name': 'volume-5450701a-1d85-4dae-8759-011992783a15', 'volume_size': 2, 'snapshot_id': 'ded3743f-3145-4271-88ed-f35cc0549517'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fac2443-b808-4e9c-b964-b981feae23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fac2443-b808-4e9c-b964-b981feae23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e41c3-17dd-46cd-a751-0d62bd1671eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Volume 5450701a-1d85-4dae-8759-011992783a15: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5450701a-1d85-4dae-8759-011992783a15', 'volume_size': 2, 'snapshot_id': 'ded3743f-3145-4271-88ed-f35cc0549517'}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517-5450701a-1d85-4dae-8759-011992783a15" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517-5450701a-1d85-4dae-8759-011992783a15" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Creating volume 5450701a-1d85-4dae-8759-011992783a15 from snapshot ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] snapshot: ded3743f-3145-4271-88ed-f35cc0549517, volume: 5450701a-1d85-4dae-8759-011992783a15,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Flow 'volume_create_manager' (6f558635-8f52-419f-b30c-e82038e42077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29131e98-1932-41a0-8738-6e318706ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29131e98-1932-41a0-8738-6e318706ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441622932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=31f73a91-d0c3-4dd0-801b-a8a2b8717f37,host='devstack@QuobyteHD#QuobyteHD',id=de84cce4-94f4-4739-bd8e-8d3aba9494b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2565c15ed44bb2bcd5a08eca128032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:05Z,use_quota=True,user_id='4348cdd891814138bafca45c88f925b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b29d221-477a-4283-8d04-b478aeb07d49),volume_type_id=4b29d221-477a-4283-8d04-b478aeb07d49)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db990e0-bb1f-45b4-936c-51cdd8286478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db990e0-bb1f-45b4-936c-51cdd8286478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecef1d39-962c-40d6-88c1-5cdda21f92a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecef1d39-962c-40d6-88c1-5cdda21f92a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de84cce4-94f4-4739-bd8e-8d3aba9494b2', 'volume_name': 'volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e44a0-43de-4001-a0ba-149a007b932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e44a0-43de-4001-a0ba-149a007b932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead86dc9-4417-4c26-8eac-23f739b9f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:04 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Volume de84cce4-94f4-4739-bd8e-8d3aba9494b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2', 'volume_size': 1}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0100f-05d9-4ce8-a149-9c164eef6fab]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:04 devstack sudo[95372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:52:04 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:05 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.955s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752a35d-c776-469a-99b9-f253d2018cc0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:05 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:52:05 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:06 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 0.974s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:06 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:52:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:06 devstack sudo[95382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15
Jul 02 04:52:06 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Acquiring lock "cinder-21f34daa-f212-4ffc-8323-7a69c569bd55-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "cinder-21f34daa-f212-4ffc-8323-7a69c569bd55-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Acquiring lock "cinder-quobyte-21f34daa-f212-4ffc-8323-7a69c569bd55" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "cinder-quobyte-21f34daa-f212-4ffc-8323-7a69c569bd55" acquired by "delete_volume" :: waited 0.052s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352a638-e0d6-451b-bd4b-0166cef5393d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:12 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55
Jul 02 04:52:12 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:14 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55" returned: 0 in 2.609s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:14 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55
Jul 02 04:52:14 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:14 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15" returned: 0 in 7.742s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e396f-8543-485c-8491-55d6c9a8ec4f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:14 devstack sudo[95482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:52:14 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:15 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f34daa-f212-4ffc-8323-7a69c569bd55" returned: 0 in 0.707s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "cinder-quobyte-21f34daa-f212-4ffc-8323-7a69c569bd55" released by "delete_volume" :: held 3.422s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Created reservations ['1925ffdd-1ddc-4226-b46b-3002b4f9ef3c', 'a43a737b-7b80-4a44-b7d8-9fd212ffa7c1', '9f9e94c3-301c-4678-b8f0-c3e263a0e238', '19e9534e-997d-4407-934d-a243fa605c83'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:15 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:15 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:15 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 1.059s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:52:15 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Converted 1024.00 MB image at 132.21 MB/s
Jul 02 04:52:15 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 is being set with open permissions: ugo+rw
Jul 02 04:52:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:15 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15
Jul 02 04:52:15 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:16 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.818s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Deleted volume successfully.
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2e80d994-d8b9-41ff-a7bd-34b3c68ffdbe tempest-ServerRescueNegativeTestJSON-1812166147 None] Lock "cinder-21f34daa-f212-4ffc-8323-7a69c569bd55-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:16 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15" returned: 0 in 0.755s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" released by "_copy_volume_from_snapshot" :: held 11.703s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517-5450701a-1d85-4dae-8759-011992783a15" released by "_create_volume_from_snapshot" :: held 11.752s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.786s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.568s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=31f73a91-d0c3-4dd0-801b-a8a2b8717f37,created_at=2026-07-02T02:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441622932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=31f73a91-d0c3-4dd0-801b-a8a2b8717f37,host='devstack@QuobyteHD#QuobyteHD',id=de84cce4-94f4-4739-bd8e-8d3aba9494b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd2565c15ed44bb2bcd5a08eca128032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:05Z,use_quota=True,user_id='4348cdd891814138bafca45c88f925b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b29d221-477a-4283-8d04-b478aeb07d49),volume_type_id=4b29d221-477a-4283-8d04-b478aeb07d49)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Creating volume de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:52:16 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:16 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 1073741824
Jul 02 04:52:16 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e41c3-17dd-46cd-a751-0d62bd1671eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5450701a-1d85-4dae-8759-011992783a15', 'volume_size': 2, 'snapshot_id': 'ded3743f-3145-4271-88ed-f35cc0549517'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08a62cb-0d01-4f31-a4d9-fe97a0c7345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:16 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Volume volume-5450701a-1d85-4dae-8759-011992783a15 (5450701a-1d85-4dae-8759-011992783a15): created successfully
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08a62cb-0d01-4f31-a4d9-fe97a0c7345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (39ac4d63-531a-472b-bd1c-2004fade577a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6c407aaa-ec5d-42d2-a7f7-f60f46e41d6b tempest-VolumesSnapshotTestJSON-385717898 None] Created volume successfully.
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-5450701a-1d85-4dae-8759-011992783a15-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-5450701a-1d85-4dae-8759-011992783a15-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d022be-af99-46ed-b41f-b7b7dbcf2473]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:17 devstack sudo[95498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15
Jul 02 04:52:17 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:17 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 1073741824" returned: 0 in 1.125s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:17 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2
Jul 02 04:52:17 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:18 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15" returned: 0 in 1.667s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:18 devstack sudo[95545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15
Jul 02 04:52:18 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:18 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2" returned: 0 in 1.163s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead86dc9-4417-4c26-8eac-23f739b9f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94de077b-f830-4e60-863e-812030431b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:18 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Volume volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 (de84cce4-94f4-4739-bd8e-8d3aba9494b2): created successfully
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94de077b-f830-4e60-863e-812030431b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Flow 'volume_create_manager' (6f558635-8f52-419f-b30c-e82038e42077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9dbc2772-86fa-41e3-81a4-cd7f0bba4326 tempest-GroupSnapshotsV319Test-1653105811 None] Created volume successfully.
Jul 02 04:52:19 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5450701a-1d85-4dae-8759-011992783a15" returned: 0 in 0.789s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-5450701a-1d85-4dae-8759-011992783a15" released by "delete_volume" :: held 2.539s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['fe20f470-c93f-43e8-a993-f46227c50a1a', '7e1258dd-f54b-45df-af50-ba007fa70db5', 'd9ff1c93-4aee-4fde-b8da-f38cd7b8998f', 'd8a6d9d0-b96e-42aa-883a-da5c37cd6820'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:19 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:19 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] GroupSnapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: creating.
Jul 02 04:52:19 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Group snapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: creating. {{(pid=86158) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Creating offline snapshot 69fadd77-dd35-4ee6-8feb-449b5bc6851f of volume de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b144a-2978-4f2b-b2c0-0b2807593e5c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:20 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2
Jul 02 04:52:20 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-ded3743f-3145-4271-88ed-f35cc0549517-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-ded3743f-3145-4271-88ed-f35cc0549517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Deleting offline snapshot ded3743f-3145-4271-88ed-f35cc0549517 of volume a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] snapshot_file for this snap is: volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14d7e9-a723-433a-bba7-ff2f6cf8dfad]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:20 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.917s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:20 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Deleted volume successfully.
Jul 02 04:52:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-420221f0-7ca8-44fb-bb99-c0f7e453d8f9 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-5450701a-1d85-4dae-8759-011992783a15-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:20 devstack sudo[95559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:52:20 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:21 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2" returned: 0 in 1.009s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:21 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f 1G
Jul 02 04:52:21 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:21 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.992s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe169db-7d2b-45d4-8f2c-d9348ff6912c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:21 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:52:21 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:22 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f 1G" returned: 0 in 0.946s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:22 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f
Jul 02 04:52:22 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:22 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 0.876s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:22 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:52:22 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:22 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f" returned: 0 in 0.836s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:22 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:52:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:22 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f
Jul 02 04:52:22 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:23 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.922s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:23 devstack sudo[95594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517
Jul 02 04:52:23 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:23 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f" returned: 0 in 0.700s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:23 devstack sudo[95597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info
Jul 02 04:52:23 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:23 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f.ded3743f-3145-4271-88ed-f35cc0549517" returned: 0 in 0.686s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-ded3743f-3145-4271-88ed-f35cc0549517" released by "_delete_snapshot" :: held 3.605s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" released by "delete_snapshot" :: held 3.636s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['46000d72-8c64-4b8a-9ec2-e50821dba368', '0f6e23e1-f564-49ac-949f-5d32b8b25d0c', '0a219d2c-1a9f-4b1e-a326-6dbbbfc4aa27', '651e7ff2-0470-411f-adda-8cd29757d11d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Delete snapshot completed successfully.
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7250cf1a-5264-4c4d-b107-cd1f23717de1 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-ded3743f-3145-4271-88ed-f35cc0549517-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:24 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info" returned: 0 in 0.764s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:24 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:24 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info
Jul 02 04:52:24 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0495cbb2-3934-430c-bf70-bf343d8fe33c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:24 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:52:24 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:25 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.info" returned: 0 in 0.882s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.259s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:25 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b60760b2-dda8-44c0-9a48-69138b395a80 tempest-GroupSnapshotsV319Test-1653105811 None] group_snapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: created successfully
Jul 02 04:52:25 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 0.844s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:25 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f
Jul 02 04:52:25 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:26 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" returned: 0 in 0.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f" released by "delete_volume" :: held 1.595s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['f12f72d1-b7ef-4396-833c-9772a2077fd9', 'dbf6d781-99d0-45cd-97f3-d99d51d9caf7', '71027acf-c6ec-47d1-9beb-6b3e82fa3531', '3c5fac02-cf7e-47d5-9945-0a849f7672bf'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:26 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:26 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:26 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] group_snapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: deleting
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] group_snapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: deleting {{(pid=86158) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "cinder-quobyte-69fadd77-dd35-4ee6-8feb-449b5bc6851f" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-69fadd77-dd35-4ee6-8feb-449b5bc6851f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Deleting offline snapshot 69fadd77-dd35-4ee6-8feb-449b5bc6851f of volume de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] snapshot_file for this snap is: volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d58ae-6cdd-4826-9efc-b63c0e917038]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:27 devstack sudo[95656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f
Jul 02 04:52:27 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:27 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.809s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Deleted volume successfully.
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-789d5f0d-7efc-43a6-b932-9c11ee09f9fe tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-a80e1b67-11cc-4b2e-bf8c-03d350dbb06f-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (ee669a8c-c2a6-404a-89ee-2d26d3164fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29b4da-a122-4c87-a1aa-c489ea4edc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29b4da-a122-4c87-a1aa-c489ea4edc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-399847999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83326455-b583-4975-82c7-1b4d59649d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:27Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd8a121-63bb-4726-8078-c771229c3d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd8a121-63bb-4726-8078-c771229c3d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dabf9e-ba96-44ef-95e0-fbf633567247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dabf9e-ba96-44ef-95e0-fbf633567247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83326455-b583-4975-82c7-1b4d59649d29', 'volume_name': 'volume-83326455-b583-4975-82c7-1b4d59649d29', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecfcf4f-3e57-4fcb-b7cc-43e6bbd87620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecfcf4f-3e57-4fcb-b7cc-43e6bbd87620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47324153-026f-4a58-9e9c-f63747cf567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Volume 83326455-b583-4975-82c7-1b4d59649d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83326455-b583-4975-82c7-1b4d59649d29', 'volume_size': 1}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-399847999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83326455-b583-4975-82c7-1b4d59649d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:27Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Creating volume 83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:52:27 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:27 devstack sudo[95659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 1073741824
Jul 02 04:52:27 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:27 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f" returned: 0 in 0.896s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[254511a2-5038-4f35-acd5-1df0c0646535]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:28 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2
Jul 02 04:52:28 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:28 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 1073741824" returned: 0 in 0.845s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:28 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=78,cinder:INSERT=22,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:52:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:28 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:28 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:28 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2" returned: 0 in 0.823s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:28 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f
Jul 02 04:52:28 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:29 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47324153-026f-4a58-9e9c-f63747cf567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83326455-b583-4975-82c7-1b4d59649d29', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd0fa18-6e44-4697-aa8e-2b7fada86ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Volume volume-83326455-b583-4975-82c7-1b4d59649d29 (83326455-b583-4975-82c7-1b4d59649d29): created successfully
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd0fa18-6e44-4697-aa8e-2b7fada86ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (ee669a8c-c2a6-404a-89ee-2d26d3164fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3c68cf8c-9155-4b4d-bfac-878f9c328a2c tempest-VolumesSnapshotTestJSON-385717898 None] Created volume successfully.
Jul 02 04:52:29 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f" returned: 0 in 0.782s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:29 devstack sudo[95682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f
Jul 02 04:52:29 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Creating offline snapshot 3b2a7ddb-d132-400e-a948-89ad8ac4d307 of volume 83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716bf84-9f1a-439e-9531-bbc7273c48fc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:30 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:30 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:30 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2.69fadd77-dd35-4ee6-8feb-449b5bc6851f" returned: 0 in 0.739s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-69fadd77-dd35-4ee6-8feb-449b5bc6851f" released by "_delete_snapshot" :: held 3.357s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" released by "delete_snapshot" :: held 3.388s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:30 devstack cinder-volume[86158]: WARNING cinder.quota [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-701726668 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-701726668, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:52:30 devstack cinder-volume[86158]: WARNING cinder.quota [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-701726668 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-701726668, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] Created reservations ['e0c927c3-ce32-4ac2-9f1c-476f8736dbd4', '3c3c43f1-7138-4859-8be1-ca8e3f58e4e8', 'c7e595d2-ac35-4196-9905-2202f3d3c27c', 'dd4ff239-9a7e-43fe-a9d0-2e0ddf93c3e0'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:30 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0446de07-1ac3-4390-b8dc-6cf2c491ff32 tempest-GroupSnapshotsV319Test-1653105811 None] group_snapshot 5dcff494-f890-4fb8-80a2-d36958ac1773: deleted successfully
Jul 02 04:52:30 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 0.870s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:30 devstack sudo[95692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 1G
Jul 02 04:52:30 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:31 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 1G" returned: 0 in 0.909s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83326455-b583-4975-82c7-1b4d59649d29 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:31 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83326455-b583-4975-82c7-1b4d59649d29 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:31 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c724cd2-5759-4100-a0ee-5cae5044d693]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:32 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2
Jul 02 04:52:32 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:32 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83326455-b583-4975-82c7-1b4d59649d29 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.943s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:32 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 is being set with open permissions: ugo+rw
Jul 02 04:52:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:32 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:32 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:32 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2" returned: 0 in 0.962s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:32 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2
Jul 02 04:52:32 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:33 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.785s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:33 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info
Jul 02 04:52:33 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:33 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-de84cce4-94f4-4739-bd8e-8d3aba9494b2" returned: 0 in 0.762s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "cinder-quobyte-de84cce4-94f4-4739-bd8e-8d3aba9494b2" released by "delete_volume" :: held 1.808s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Created reservations ['5a890523-7cae-4f27-9fa6-8a24685d167e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:33 devstack cinder-volume[86158]: WARNING cinder.quota [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-701726668 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-701726668, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Created reservations ['2a72afbb-d321-4ce5-8413-47198b05a35a', 'b7a249d2-c2a2-4230-b4b8-51dd84ade8f4', '7b2a0d3f-9bcf-4c80-972c-668c422e0ee2', 'c67f1a1c-c2a6-4b03-a780-f12b13462a11'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:33 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:33 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:34 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info" returned: 0 in 0.814s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:34 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info is being set with open permissions: ugo+rw
Jul 02 04:52:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:34 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info
Jul 02 04:52:34 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:34 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.885s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:34 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-158bace8-5077-4293-9331-27e40a43f497 tempest-GroupSnapshotsV319Test-1653105811 None] Delete group completed successfully.
Jul 02 04:52:35 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.info" returned: 0 in 0.744s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.186s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9c5ecc87-9cd2-4e41-aba9-6f4b812a1f12 tempest-VolumesSnapshotTestJSON-385717898 None] Create snapshot completed successfully
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (04a38b86-e878-4b6b-9504-c43c69668d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18aa84e-215c-42f8-bfea-93df44faec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18aa84e-215c-42f8-bfea-93df44faec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426791933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117c7c70b0f448e88766583c4da59a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b2a7ddb-d132-400e-a948-89ad8ac4d307,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:37Z,use_quota=True,user_id='acc195544cb04375abcb00759058effe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a46863b-3c13-4d6f-ac77-f287ce27994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a46863b-3c13-4d6f-ac77-f287ce27994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b519cb6-b026-40be-96ca-4469b7d5c385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b519cb6-b026-40be-96ca-4469b7d5c385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa', 'volume_name': 'volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa', 'volume_size': 1, 'snapshot_id': '3b2a7ddb-d132-400e-a948-89ad8ac4d307'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5166e4-162f-470d-aff4-b6dc24804acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5166e4-162f-470d-aff4-b6dc24804acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e10f01-137a-464b-b429-62a9b0273a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Volume 2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa', 'volume_size': 1, 'snapshot_id': '3b2a7ddb-d132-400e-a948-89ad8ac4d307'}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Creating volume 2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa from snapshot 3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] snapshot: 3b2a7ddb-d132-400e-a948-89ad8ac4d307, volume: 2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc738ed-bcca-429a-8b40-f6d43858e049]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:37 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:37 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:37 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.880s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83326455-b583-4975-82c7-1b4d59649d29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:52:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:52:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8561a93-8f30-45ea-9eff-1537c5da5613]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:38 devstack sudo[95731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:38 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:38 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 0.929s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:38 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:52:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:38 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa
Jul 02 04:52:38 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:45 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" returned: 0 in 6.231s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:45 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfedd40-4c6a-47dd-9744-e2aeae7d6640]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:45 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:45 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:46 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 1.118s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:46 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:52:46 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Converted 1024.00 MB image at 164.30 MB/s
Jul 02 04:52:46 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa is being set with open permissions: ugo+rw
Jul 02 04:52:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:46 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa
Jul 02 04:52:46 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=23,cinder:SELECT=19,cinder:INSERT=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=64,cinder:UPDATE=65,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:52:47 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" returned: 0 in 0.832s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" released by "_copy_volume_from_snapshot" :: held 10.114s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" released by "_create_volume_from_snapshot" :: held 10.155s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.173s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e10f01-137a-464b-b429-62a9b0273a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa', 'volume_size': 1, 'snapshot_id': '3b2a7ddb-d132-400e-a948-89ad8ac4d307'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ad24f-5b83-41a0-a706-6a246ee89f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:47 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Volume volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa (2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa): created successfully
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (287ad24f-5b83-41a0-a706-6a246ee89f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Flow 'volume_create_manager' (04a38b86-e878-4b6b-9504-c43c69668d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:47 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a43ff08a-e39c-4f75-af1a-394ec581bdd6 tempest-VolumesSnapshotTestJSON-385717898 None] Created volume successfully.
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3edd1b-7189-49db-a75c-8e4fc2f31a9c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:48 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa
Jul 02 04:52:48 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:49 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" returned: 0 in 1.041s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:49 devstack sudo[95808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa
Jul 02 04:52:49 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:50 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" returned: 0 in 0.770s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa" released by "delete_volume" :: held 1.856s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['16a4ecc7-3b2f-4ecb-9abf-bfe549d9278e', 'c67a9da8-f119-4ed7-8d84-c40b92cf410c', '158ded69-eb12-483a-905d-9e79003fcabd', 'e6187ce4-7251-4d50-8b51-7b588110c7c2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:50 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:50 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-3b2a7ddb-d132-400e-a948-89ad8ac4d307-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-3b2a7ddb-d132-400e-a948-89ad8ac4d307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Deleting offline snapshot 3b2a7ddb-d132-400e-a948-89ad8ac4d307 of volume 83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] snapshot_file for this snap is: volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a7c164-be42-4e23-bfc8-b05c08e7bfb0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:50 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:50 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:51 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.791s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Deleted volume successfully.
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7f5a6283-33c9-4980-8a25-01873ddfc21b tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-2d1db143-d40b-4ea3-ae61-0ea7fd50cdaa-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:51 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.847s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83326455-b583-4975-82c7-1b4d59649d29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[351a97c4-14ca-421f-9d3a-35790b4afe6f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:51 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:51 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:51 devstack sudo[95824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:51 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Flow 'volume_create_manager' (941f1b03-400f-4eed-89df-e69fb4f375fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ae08b8-c274-4ce2-86de-2cb905ffb5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ae08b8-c274-4ce2-86de-2cb905ffb5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-466691589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bed8b0-641d-4e86-bf18-66cddfdd9fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='930461f55a7f41a0b3f14387f527888d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:52Z,use_quota=True,user_id='7dc084183ee04aa193770a584ab67e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e483f102-a562-4ab9-a0b5-3f4f935814d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e483f102-a562-4ab9-a0b5-3f4f935814d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1fa2fa-276a-46e0-af16-d1ff6a3af37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1fa2fa-276a-46e0-af16-d1ff6a3af37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50bed8b0-641d-4e86-bf18-66cddfdd9fae', 'volume_name': 'volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fca634-149c-45c2-8699-38dc13107697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fca634-149c-45c2-8699-38dc13107697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c491cdee-3d66-4ed5-83e4-d72b9077df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:52 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Volume 50bed8b0-641d-4e86-bf18-66cddfdd9fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae', 'volume_size': 1}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-466691589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bed8b0-641d-4e86-bf18-66cddfdd9fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='930461f55a7f41a0b3f14387f527888d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:52:52Z,use_quota=True,user_id='7dc084183ee04aa193770a584ab67e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Creating volume 50bed8b0-641d-4e86-bf18-66cddfdd9fae {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:52:52 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:52 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae 1073741824
Jul 02 04:52:52 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:52 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 1.062s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:52 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:52 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:52 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.799s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:52:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:52:53 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae 1073741824" returned: 0 in 1.044s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:53 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae
Jul 02 04:52:53 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:53 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.847s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:53 devstack sudo[95849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307
Jul 02 04:52:53 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:53 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae" returned: 0 in 0.669s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:52:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c491cdee-3d66-4ed5-83e4-d72b9077df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba5517-4487-4bed-b459-67ee4025efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:52:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Volume volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae (50bed8b0-641d-4e86-bf18-66cddfdd9fae): created successfully
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba5517-4487-4bed-b459-67ee4025efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Flow 'volume_create_manager' (941f1b03-400f-4eed-89df-e69fb4f375fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:52:54 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9d6b2f11-fbfc-46da-878c-ebba66ee2a95 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Created volume successfully.
Jul 02 04:52:54 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29.3b2a7ddb-d132-400e-a948-89ad8ac4d307" returned: 0 in 0.696s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-3b2a7ddb-d132-400e-a948-89ad8ac4d307" released by "_delete_snapshot" :: held 3.581s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" released by "delete_snapshot" :: held 3.614s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['7c421907-d2ae-4076-9e43-085f6b251ef8', '368aa2a5-eca6-44e8-9a09-a12ecdfeb746', 'abd51c88-3f20-419d-a4bc-26d12168e332', '820d8eb5-c330-474f-bd1e-902926512606'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:54 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Delete snapshot completed successfully.
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-af66fbe5-8ec5-4420-9fe1-76b2e37dbe57 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-3b2a7ddb-d132-400e-a948-89ad8ac4d307-delete_snapshot" released by "delete_snapshot" :: held 3.768s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-83326455-b583-4975-82c7-1b4d59649d29-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-83326455-b583-4975-82c7-1b4d59649d29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37e84c7-a308-4aab-8dbe-101c06a2e1d2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:55 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:55 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Acquiring lock "cinder-50bed8b0-641d-4e86-bf18-66cddfdd9fae-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "cinder-50bed8b0-641d-4e86-bf18-66cddfdd9fae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Acquiring lock "cinder-quobyte-50bed8b0-641d-4e86-bf18-66cddfdd9fae" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "cinder-quobyte-50bed8b0-641d-4e86-bf18-66cddfdd9fae" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec673e6-07c1-4904-8fda-2996b05a49d2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:55 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae
Jul 02 04:52:55 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:55 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 0.933s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:55 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29
Jul 02 04:52:55 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:56 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae" returned: 0 in 0.802s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:56 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae
Jul 02 04:52:56 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:56 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83326455-b583-4975-82c7-1b4d59649d29" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-83326455-b583-4975-82c7-1b4d59649d29" released by "delete_volume" :: held 1.689s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['3fd2d2a3-6021-4c56-b09b-13fab460a5e6', 'd614747f-0910-412b-856a-c3148d8198e3', '5926b81e-1778-42c2-8964-f6617cbb7668', 'f40b0322-b986-4b79-b65c-2d753f382773'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:56 devstack sudo[95868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:56 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:57 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50bed8b0-641d-4e86-bf18-66cddfdd9fae" returned: 0 in 0.737s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "cinder-quobyte-50bed8b0-641d-4e86-bf18-66cddfdd9fae" released by "delete_volume" :: held 1.594s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Created reservations ['ddb320c5-0802-47ae-be9c-8cba57f5961f', '2c644e28-caaf-4257-843d-a06cd8aba28e', '99725b82-36b9-434c-a6c5-c8b7f17dca71', '51f1c241-368d-47dd-bfd4-63f1db32d071'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015918e-5db2-4ec6-84e8-f21921b344e5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:57 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:57 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:57 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3
Jul 02 04:52:57 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:57 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.778s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Deleted volume successfully.
Jul 02 04:52:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7af62b96-49d8-48dd-b290-cf6394d87fa3 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-83326455-b583-4975-82c7-1b4d59649d29-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:58 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.054s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:58 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:52:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Deleted volume successfully.
Jul 02 04:52:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bf132f98-387f-4dc0-a655-13d715bef8d4 tempest-VolumeQuotasNegativeTestJSON-1577850932 None] Lock "cinder-50bed8b0-641d-4e86-bf18-66cddfdd9fae-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:58 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" returned: 0 in 1.268s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:58 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3
Jul 02 04:52:58 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:52:59 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-quobyte-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3" released by "delete_volume" :: held 2.215s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Created reservations ['a34aa221-1a44-4a61-9d59-a031265f1da6', '82b7d868-e51f-46d1-accc-95ba5d32a742', '42bb7ff2-bdb9-4a2e-aa69-8107fdb282c5', '04961ef3-93c4-48a1-bd79-295c0ac9b879'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:52:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:52:59 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:52:59 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:00 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:00 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:00 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Deleted volume successfully.
Jul 02 04:53:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-82ec449e-feed-42bd-a37b-9d2ae0452479 tempest-VolumesSnapshotTestJSON-385717898 None] Lock "cinder-867ad7f2-7355-4be1-b81b-a7b0dd2a80d3-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Flow 'volume_create_manager' (4f634b0b-5e9f-4e13-96c1-6f6443ae733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a0f1f-5293-4467-a905-b128824e8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a0f1f-5293-4467-a905-b128824e8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-591427694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5319679de44828acc32dd72ccbab44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:08Z,use_quota=True,user_id='4eefbd9ff10d448a8bffa19859d49784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf8cc04-5bfa-4fd6-9e9f-8ccc9fbd9d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf8cc04-5bfa-4fd6-9e9f-8ccc9fbd9d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b3cc6c-5cc0-4f9b-8c5e-a5f2ef466885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b3cc6c-5cc0-4f9b-8c5e-a5f2ef466885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9', 'volume_name': 'volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d12210-b806-407e-9b83-b512dcccec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d12210-b806-407e-9b83-b512dcccec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0b2fd-8668-47c3-9fc2-a5939c51a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9', 'volume_size': 1}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-591427694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f5319679de44828acc32dd72ccbab44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:08Z,use_quota=True,user_id='4eefbd9ff10d448a8bffa19859d49784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Creating volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:53:08 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:53:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:08 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 1073741824
Jul 02 04:53:08 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:09 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 1073741824" returned: 0 in 1.417s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:09 devstack sudo[95985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9
Jul 02 04:53:09 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:10 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" returned: 0 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e0b2fd-8668-47c3-9fc2-a5939c51a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b6023-f799-4112-ae63-89189fd323f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:10 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Volume volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 (4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9): created successfully
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b6023-f799-4112-ae63-89189fd323f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Flow 'volume_create_manager' (4f634b0b-5e9f-4e13-96c1-6f6443ae733f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-05f63af3-21db-4a75-b546-1d3ca306d10a tempest-VolumesSnapshotListTestJSON-26772215 None] Created volume successfully.
Jul 02 04:53:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Creating offline snapshot 7d2e2985-438e-48ca-bf13-9c8710790bce of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:53:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0677de58-be85-45ec-87cd-99ec5051aa53]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:11 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9
Jul 02 04:53:11 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:12 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" returned: 0 in 1.159s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:12 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce 1G
Jul 02 04:53:12 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:13 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce 1G" returned: 0 in 1.017s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:13 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:13 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:14 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 0.919s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:14 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce is being set with open permissions: ugo+rw
Jul 02 04:53:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:14 devstack sudo[96009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:14 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:15 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 0.907s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:15 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info
Jul 02 04:53:15 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:16 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info" returned: 0 in 0.863s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:16 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info is being set with open permissions: ugo+rw
Jul 02 04:53:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:16 devstack sudo[96016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info
Jul 02 04:53:16 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:17 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.info" returned: 0 in 0.875s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.881s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:17 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2bc8fbf2-eda6-4067-9136-ac8d59362c23 tempest-VolumesSnapshotListTestJSON-26772215 None] Create snapshot completed successfully
Jul 02 04:53:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Creating offline snapshot f1e0080b-17d4-4115-9ceb-496fe32acc63 of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:53:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefcc4f0-6746-4486-be5c-f0c0cdfde90b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:18 devstack sudo[96019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:18 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:19 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 1.385s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:19 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 1G
Jul 02 04:53:19 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:20 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 1G" returned: 0 in 1.104s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:20 devstack sudo[96064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:20 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:21 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 0.774s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:21 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 is being set with open permissions: ugo+rw
Jul 02 04:53:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:21 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:21 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:22 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 0.702s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ba868c3b-ff6d-4c4d-b160-322e81f5aee6 tempest-VolumesSnapshotListTestJSON-26772215 None] Create snapshot completed successfully
Jul 02 04:53:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Creating offline snapshot 69b7cf55-1fc9-4035-825b-dac183836b64 of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:53:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecced630-6f26-4356-b31e-f8d95b971c9d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:23 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:23 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:24 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 0.797s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:24 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 1G
Jul 02 04:53:24 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:25 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 1G" returned: 0 in 1.275s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:25 devstack sudo[96125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64
Jul 02 04:53:25 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:26 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64" returned: 0 in 1.035s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:26 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 is being set with open permissions: ugo+rw
Jul 02 04:53:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:26 devstack sudo[96130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64
Jul 02 04:53:26 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:27 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64" returned: 0 in 0.773s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.060s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f517e61b-ed43-423b-bbbd-a2b88e64a339 tempest-VolumesSnapshotListTestJSON-26772215 None] Create snapshot completed successfully
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-69b7cf55-1fc9-4035-825b-dac183836b64-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-69b7cf55-1fc9-4035-825b-dac183836b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-69b7cf55-1fc9-4035-825b-dac183836b64" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-69b7cf55-1fc9-4035-825b-dac183836b64" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Deleting offline snapshot 69b7cf55-1fc9-4035-825b-dac183836b64 of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] snapshot_file for this snap is: volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5666737-0c53-4312-a9c2-7ce82960d593]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:29 devstack sudo[96136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64
Jul 02 04:53:29 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:31 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64" returned: 0 in 1.466s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f2d04-95ee-4285-88e6-bab00a5fd44a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:31 devstack sudo[96146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:31 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:32 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 1.446s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:32 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64
Jul 02 04:53:32 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Acquiring lock "cinder-ffe64cb7-b8a2-47c8-8960-24507df90516-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "cinder-ffe64cb7-b8a2-47c8-8960-24507df90516-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Acquiring lock "cinder-quobyte-ffe64cb7-b8a2-47c8-8960-24507df90516" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "cinder-quobyte-ffe64cb7-b8a2-47c8-8960-24507df90516" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a83a0dd-2a3e-4002-8831-6e0239e1b9d5]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:33 devstack sudo[96191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:53:33 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:33 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64" returned: 0 in 1.139s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:33 devstack sudo[96193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64
Jul 02 04:53:33 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:34 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 1.282s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:34 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.69b7cf55-1fc9-4035-825b-dac183836b64" returned: 0 in 1.025s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-69b7cf55-1fc9-4035-825b-dac183836b64" released by "_delete_snapshot" :: held 5.214s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" released by "delete_snapshot" :: held 5.249s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:34 devstack sudo[96199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:53:34 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:34 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Created reservations ['0bd169b2-0572-4b18-bf57-132ee3395a80', '80b969ea-6eee-4098-a985-5be653197347', '0983033b-b23a-4349-abab-f49164f11d96', 'dd1d72fc-e282-486a-98bf-0a6fc826ef8b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Delete snapshot completed successfully.
Jul 02 04:53:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-f747f11b-b470-4399-9734-2a5bcfd47711 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-69b7cf55-1fc9-4035-825b-dac183836b64-delete_snapshot" released by "delete_snapshot" :: held 5.581s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:35 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 1 in 1.006s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:53:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:35 devstack sudo[96204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516
Jul 02 04:53:35 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-f1e0080b-17d4-4115-9ceb-496fe32acc63-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-f1e0080b-17d4-4115-9ceb-496fe32acc63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-f1e0080b-17d4-4115-9ceb-496fe32acc63" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-f1e0080b-17d4-4115-9ceb-496fe32acc63" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Deleting offline snapshot f1e0080b-17d4-4115-9ceb-496fe32acc63 of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] snapshot_file for this snap is: volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4ba4e-177f-4d6b-83a9-7cc73bb89953]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:36 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:36 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:36 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ffe64cb7-b8a2-47c8-8960-24507df90516" returned: 0 in 0.826s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "cinder-quobyte-ffe64cb7-b8a2-47c8-8960-24507df90516" released by "delete_volume" :: held 3.211s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.quota [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Created reservations ['e300206c-1229-40e1-8d5b-f87521d45e41', '054fd11d-b30c-450d-9a00-8dedbef0f270', '1a9af7f9-0559-4a07-bf78-05c504385d76', '0b16fc3a-ef8a-4384-a664-bec9cac714b8'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:36 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:53:36 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:37 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 1.038s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd392b30-ce23-4301-928e-21be642e3183]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:37 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:37 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:37 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.009s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG cinder.manager [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Deleted volume successfully.
Jul 02 04:53:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [req-622823a4-9dd0-44c5-af09-8785122d8340 req-a4803c9f-ff4f-4399-82bb-471d976fb82e tempest-TestShelveInstance-1392562446 None] Lock "cinder-ffe64cb7-b8a2-47c8-8960-24507df90516-delete_volume" released by "delete_volume" :: held 4.512s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:38 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 0.887s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:38 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:38 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:39 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 1.044s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:39 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63
Jul 02 04:53:39 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:40 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.f1e0080b-17d4-4115-9ceb-496fe32acc63" returned: 0 in 0.885s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-f1e0080b-17d4-4115-9ceb-496fe32acc63" released by "_delete_snapshot" :: held 3.975s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" released by "delete_snapshot" :: held 4.016s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Created reservations ['52596583-682b-430c-9eea-850c3e13a05d', 'fa6d27b2-a59d-4fab-bc6f-7a76544497b7', 'f8fb2cac-e505-4067-88a2-17a8dec9b902', '3e3fdb8f-ead0-4e76-9822-1761bf1134de'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Delete snapshot completed successfully.
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be7d9145-03c6-492c-b429-46a9581f0f80 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-f1e0080b-17d4-4115-9ceb-496fe32acc63-delete_snapshot" released by "delete_snapshot" :: held 4.226s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-7d2e2985-438e-48ca-bf13-9c8710790bce-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-7d2e2985-438e-48ca-bf13-9c8710790bce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-7d2e2985-438e-48ca-bf13-9c8710790bce" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-7d2e2985-438e-48ca-bf13-9c8710790bce" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Deleting offline snapshot 7d2e2985-438e-48ca-bf13-9c8710790bce of volume 4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] snapshot_file for this snap is: volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ffdf9-0c7e-46c4-885d-b3e6d3d825a7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:40 devstack sudo[96234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:40 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:53:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Flow 'volume_create_manager' (5fe726fc-1f35-4c8c-8e74-a07881d84e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f41819-3513-4968-b761-f0d19da636f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f41819-3513-4968-b761-f0d19da636f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2106712421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49bfc20-b385-47e8-b372-76f411e9e4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dfba4f63964570bbd86d769bf65405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:41Z,use_quota=True,user_id='4094c7991f0a4854a406a1d54010a74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaffe8a-bf94-490a-a741-cea74e65f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaffe8a-bf94-490a-a741-cea74e65f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650ca4d-83fa-4c80-8165-53c4c0a214fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650ca4d-83fa-4c80-8165-53c4c0a214fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49bfc20-b385-47e8-b372-76f411e9e4fb', 'volume_name': 'volume-b49bfc20-b385-47e8-b372-76f411e9e4fb', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be10cd4d-15e0-430a-b127-8071a20a6c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be10cd4d-15e0-430a-b127-8071a20a6c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83d0db2-f889-44b4-8563-3663cb092a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:41 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Volume b49bfc20-b385-47e8-b372-76f411e9e4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49bfc20-b385-47e8-b372-76f411e9e4fb', 'volume_size': 1}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2106712421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49bfc20-b385-47e8-b372-76f411e9e4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dfba4f63964570bbd86d769bf65405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:41Z,use_quota=True,user_id='4094c7991f0a4854a406a1d54010a74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Creating volume b49bfc20-b385-47e8-b372-76f411e9e4fb {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:53:41 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:41 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb 1073741824
Jul 02 04:53:41 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:41 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 1.002s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ed22d-2dc6-4dd9-bf65-088cd21cdebf]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:41 devstack sudo[96244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9
Jul 02 04:53:41 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:42 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb 1073741824" returned: 0 in 1.294s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:42 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb
Jul 02 04:53:42 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:42 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" returned: 0 in 1.144s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:42 devstack sudo[96259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:42 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:43 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb" returned: 0 in 0.992s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83d0db2-f889-44b4-8563-3663cb092a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49bfc20-b385-47e8-b372-76f411e9e4fb', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6c8b31-a80a-497f-b19d-ae8013585b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Volume volume-b49bfc20-b385-47e8-b372-76f411e9e4fb (b49bfc20-b385-47e8-b372-76f411e9e4fb): created successfully
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6c8b31-a80a-497f-b19d-ae8013585b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Flow 'volume_create_manager' (5fe726fc-1f35-4c8c-8e74-a07881d84e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-31f83eb6-33ad-4bab-9965-34d338042d47 tempest-ServersNegativeTestJSON-1033509417 None] Created volume successfully.
Jul 02 04:53:44 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 1.373s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:44 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce
Jul 02 04:53:44 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:44 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9.7d2e2985-438e-48ca-bf13-9c8710790bce" returned: 0 in 0.830s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-7d2e2985-438e-48ca-bf13-9c8710790bce" released by "_delete_snapshot" :: held 4.530s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" released by "delete_snapshot" :: held 4.574s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:45 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Created reservations ['9162d5b2-6f8d-48f8-9c70-c1458694dacf', '54bd7ee8-1862-4b41-80d8-8e8643351c1b', 'afb7858d-5da4-4abc-b1aa-63ba7a89af07', 'd27de459-feee-498b-8432-78d37263a9f7'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Delete snapshot completed successfully.
Jul 02 04:53:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b427be2e-8cee-429c-9c89-91a25c55710d tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-7d2e2985-438e-48ca-bf13-9c8710790bce-delete_snapshot" released by "delete_snapshot" :: held 4.797s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" acquired by "delete_volume" :: waited 0.040s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b0a0d-ea8f-4441-980c-e92eb41e5683]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Flow 'volume_create_manager' (25b453b5-e951-4393-a0b8-ac1c481887be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925b384a-ce6b-4a2f-8d92-d2e0282fa385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925b384a-ce6b-4a2f-8d92-d2e0282fa385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-487716658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67ea446-9a0a-4bce-a5d1-bc33883a5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dfba4f63964570bbd86d769bf65405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:46Z,use_quota=True,user_id='4094c7991f0a4854a406a1d54010a74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4154e551-93bd-4548-8932-e3c82ad7b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:46 devstack sudo[96310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9
Jul 02 04:53:46 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4154e551-93bd-4548-8932-e3c82ad7b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1674e854-cc6a-4e2f-aa13-935318485420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1674e854-cc6a-4e2f-aa13-935318485420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67ea446-9a0a-4bce-a5d1-bc33883a5762', 'volume_name': 'volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdd7550-f800-4d51-9d30-6de6112055be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdd7550-f800-4d51-9d30-6de6112055be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dab06e-34c5-4d05-8f3a-35986998c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:46 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Volume d67ea446-9a0a-4bce-a5d1-bc33883a5762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762', 'volume_size': 1}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-487716658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67ea446-9a0a-4bce-a5d1-bc33883a5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53dfba4f63964570bbd86d769bf65405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:46Z,use_quota=True,user_id='4094c7991f0a4854a406a1d54010a74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Creating volume d67ea446-9a0a-4bce-a5d1-bc33883a5762 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:53:46 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:53:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:46 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 1073741824
Jul 02 04:53:46 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:47 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" returned: 0 in 1.008s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:47 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9
Jul 02 04:53:47 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:47 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 1073741824" returned: 0 in 1.092s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=56,cinder:UPDATE=80,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=75,cinder:DELETE=7,cinder:SELECT=69,cinder:INSERT=19 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:47 devstack sudo[96331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762
Jul 02 04:53:47 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:47 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" returned: 0 in 0.703s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-quobyte-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9" released by "delete_volume" :: held 1.792s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Created reservations ['c267060d-a6a4-4696-b083-e1eff1f34a8e', '89dd49ae-a7ba-4933-a1f7-ab84ecfa0da4', 'd79ceb10-89b8-4098-a63b-9f4a4c6c4e09', '8e62b66f-1edf-4216-9954-483b16b33576'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:48 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:53:48 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:48 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762" returned: 0 in 0.685s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dab06e-34c5-4d05-8f3a-35986998c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e25f9f-3bf4-4692-8c5b-e92f1f242338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:48 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Volume volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 (d67ea446-9a0a-4bce-a5d1-bc33883a5762): created successfully
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e25f9f-3bf4-4692-8c5b-e92f1f242338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Flow 'volume_create_manager' (25b453b5-e951-4393-a0b8-ac1c481887be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:48 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2e7d4011-c6d6-4fc5-875f-47159a49f2fa tempest-ServersNegativeTestJSON-1033509417 None] Created volume successfully.
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "cinder-d67ea446-9a0a-4bce-a5d1-bc33883a5762-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-d67ea446-9a0a-4bce-a5d1-bc33883a5762-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "cinder-quobyte-d67ea446-9a0a-4bce-a5d1-bc33883a5762" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-quobyte-d67ea446-9a0a-4bce-a5d1-bc33883a5762" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682501d-ed60-4544-97ea-e9b5980c12bc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:49 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.162s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Deleted volume successfully.
Jul 02 04:53:49 devstack sudo[96338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762
Jul 02 04:53:49 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-794fefe2-1e88-4235-8076-d6e359785f17 tempest-VolumesSnapshotListTestJSON-26772215 None] Lock "cinder-4b3454f4-7ddc-4c9e-bc47-3efe4dfa43a9-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:50 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762" returned: 0 in 1.062s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:50 devstack sudo[96344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762
Jul 02 04:53:50 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:51 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d67ea446-9a0a-4bce-a5d1-bc33883a5762" returned: 0 in 0.953s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-quobyte-d67ea446-9a0a-4bce-a5d1-bc33883a5762" released by "delete_volume" :: held 2.107s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Created reservations ['a70d2c17-aa7c-4a55-82b3-5c750bdf49d6', 'b26b4080-c3eb-4e5f-8870-ebaf9f6ea807', 'e048e75b-2706-4375-96a7-37a32637ffe9', 'bf1fe187-d8b6-4be8-9bf4-38cbc0715f9a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:51 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:53:51 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:51 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:53:51 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:52 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Deleted volume successfully.
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4b12bfba-2698-4294-b9c4-d2002de14b49 tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-d67ea446-9a0a-4bce-a5d1-bc33883a5762-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "cinder-b49bfc20-b385-47e8-b372-76f411e9e4fb-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-b49bfc20-b385-47e8-b372-76f411e9e4fb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "cinder-quobyte-b49bfc20-b385-47e8-b372-76f411e9e4fb" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:53:52 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-quobyte-b49bfc20-b385-47e8-b372-76f411e9e4fb" acquired by "delete_volume" :: waited 0.040s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.010s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5234d46-cf7e-41e1-9cf5-be823f516f04]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:53 devstack sudo[96354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb
Jul 02 04:53:53 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:53 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb" returned: 0 in 1.147s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:54 devstack sudo[96370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb
Jul 02 04:53:54 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Flow 'volume_create_manager' (545490c0-9769-40c3-9c49-24547d5ed031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c117f9e6-1ad3-497f-a8f1-8e72bc2226e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c117f9e6-1ad3-497f-a8f1-8e72bc2226e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-14523791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f12393b-bfc4-4934-a47b-15c7271d5d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73615a3f22104475812a5dbbb453ac4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:54Z,use_quota=True,user_id='52a12eef7b6547f7b912eac316bfd0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f473a983-22cd-4f86-91fc-e38dc13446cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f473a983-22cd-4f86-91fc-e38dc13446cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7776e488-d2f0-4d7c-9506-eabdf84e5880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7776e488-d2f0-4d7c-9506-eabdf84e5880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f12393b-bfc4-4934-a47b-15c7271d5d74', 'volume_name': 'volume-2f12393b-bfc4-4934-a47b-15c7271d5d74', 'volume_size': 2}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef34fb3-7739-4710-ae90-b8c7ca474628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef34fb3-7739-4710-ae90-b8c7ca474628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbad0dfc-43c0-48b2-bd22-010d3a994702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Volume 2f12393b-bfc4-4934-a47b-15c7271d5d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f12393b-bfc4-4934-a47b-15c7271d5d74', 'volume_size': 2}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-14523791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f12393b-bfc4-4934-a47b-15c7271d5d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73615a3f22104475812a5dbbb453ac4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:54Z,use_quota=True,user_id='52a12eef7b6547f7b912eac316bfd0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Creating volume 2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:53:54 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:53:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 2147483648 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:54 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 2147483648
Jul 02 04:53:54 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:55 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b49bfc20-b385-47e8-b372-76f411e9e4fb" returned: 0 in 1.166s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-quobyte-b49bfc20-b385-47e8-b372-76f411e9e4fb" released by "delete_volume" :: held 2.403s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Created reservations ['dec2f217-4d38-4f7a-9b92-75fcada44770', '61db1e9a-10b3-40c6-a8d7-cc8ccacd95a4', '6fe97dac-1420-4322-bb22-606f5ea7a031', 'd2c3e1b3-3aba-47c5-87ed-68ebfbd47216'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:55 devstack sudo[96384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:53:55 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:55 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 2147483648" returned: 0 in 1.478s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:55 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74
Jul 02 04:53:55 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:56 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.692s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:53:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Deleted volume successfully.
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-814b463b-7a10-4025-b1ff-1768c5eab1ea tempest-ServersNegativeTestJSON-1033509417 None] Lock "cinder-b49bfc20-b385-47e8-b372-76f411e9e4fb-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Flow 'volume_create_manager' (71a27ca0-2a1c-49dd-8f8b-65a335d5684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259c82c2-f828-40e4-a904-438fdf843b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259c82c2-f828-40e4-a904-438fdf843b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1544064002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0e90e5-5e80-47d5-9b73-bbe24c47536f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c538ce27d947d1add8b4113f0055c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:56Z,use_quota=True,user_id='fd0c8240085f4fa089722b4f65a5a78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f80cc13-adb3-416f-bf83-36bd0fdc7319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f80cc13-adb3-416f-bf83-36bd0fdc7319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa698e9b-8e13-4283-910e-afe019a805a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa698e9b-8e13-4283-910e-afe019a805a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0e90e5-5e80-47d5-9b73-bbe24c47536f', 'volume_name': 'volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c51d505-fd50-44bf-9feb-4c6df4ebaded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c51d505-fd50-44bf-9feb-4c6df4ebaded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14622fe-261b-4d64-a1bf-8d6ce73d677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Volume 9d0e90e5-5e80-47d5-9b73-bbe24c47536f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f', 'volume_size': 1}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74" returned: 0 in 0.839s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.390s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1544064002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0e90e5-5e80-47d5-9b73-bbe24c47536f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c538ce27d947d1add8b4113f0055c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:53:56Z,use_quota=True,user_id='fd0c8240085f4fa089722b4f65a5a78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Creating volume 9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:53:56 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbad0dfc-43c0-48b2-bd22-010d3a994702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f12393b-bfc4-4934-a47b-15c7271d5d74', 'volume_size': 2}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f 1073741824
Jul 02 04:53:56 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17be85d4-852f-4d95-91f2-378f3ce0d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Volume volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 (2f12393b-bfc4-4934-a47b-15c7271d5d74): created successfully
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17be85d4-852f-4d95-91f2-378f3ce0d96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Flow 'volume_create_manager' (545490c0-9769-40c3-9c49-24547d5ed031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-56b14dbd-af22-4f3a-b6f7-da4d9a5b9842 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Created volume successfully.
Jul 02 04:53:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:53:57 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f 1073741824" returned: 0 in 1.109s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:57 devstack sudo[96434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:53:57 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:58 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 0.749s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.060s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Creating offline snapshot fed2ceb8-2d33-40d1-9c51-03358b1757f4 of volume 2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14622fe-261b-4d64-a1bf-8d6ce73d677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11105cd-4fc8-4ff6-be75-4e91126713aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c55e81b-6c49-4991-959d-a62f7386872f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Volume volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f (9d0e90e5-5e80-47d5-9b73-bbe24c47536f): created successfully
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11105cd-4fc8-4ff6-be75-4e91126713aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:53:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Flow 'volume_create_manager' (71a27ca0-2a1c-49dd-8f8b-65a335d5684d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:53:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5a8078fb-dc79-4395-a674-2e8169af41b7 tempest-VolumeDependencyTests-1502422027 None] Created volume successfully.
Jul 02 04:53:58 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74
Jul 02 04:53:58 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:59 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Jul 02 04:53:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74" returned: 0 in 0.828s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:53:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 2G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:53:59 devstack sudo[96448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 2G
Jul 02 04:53:59 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:53:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:00 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 2G" returned: 0 in 1.018s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:00 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4
Jul 02 04:54:00 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:01 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4" returned: 0 in 1.016s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:01 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 is being set with open permissions: ugo+rw
Jul 02 04:54:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:01 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4
Jul 02 04:54:01 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:02 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4" returned: 0 in 0.687s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:02 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info
Jul 02 04:54:02 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:02 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info" returned: 0 in 0.683s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:02 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info is being set with open permissions: ugo+rw
Jul 02 04:54:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:02 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info
Jul 02 04:54:02 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:03 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.info" returned: 0 in 0.695s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.022s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.717s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Creating offline snapshot 9e56b7b6-33b0-4169-9174-6043ceb57f02 of volume 9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:54:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b9522e0d-0057-451b-b305-876330546dfd tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Create snapshot completed successfully
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca5c27-5bf3-4a7a-a2d7-65b7c95d874f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:03 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:03 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "cinder-fed2ceb8-2d33-40d1-9c51-03358b1757f4-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-fed2ceb8-2d33-40d1-9c51-03358b1757f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "cinder-quobyte-fed2ceb8-2d33-40d1-9c51-03358b1757f4" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-fed2ceb8-2d33-40d1-9c51-03358b1757f4" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Deleting offline snapshot fed2ceb8-2d33-40d1-9c51-03358b1757f4 of volume 2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] snapshot_file for this snap is: volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1204a2-244d-469b-b777-602b65153452]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:04 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4
Jul 02 04:54:04 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (19e8fc89-62fa-4609-9341-c792984a1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33977a7e-0b51-4a9f-b8fe-7d3cb5269adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33977a7e-0b51-4a9f-b8fe-7d3cb5269adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608662492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256a3fa-7d34-4dfe-92cc-7c01a855f443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:05Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdddac8a-df2f-449f-83aa-5bc5d2196161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdddac8a-df2f-449f-83aa-5bc5d2196161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5ad42b-775e-48b3-9a22-a8ef17be2c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5ad42b-775e-48b3-9a22-a8ef17be2c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3256a3fa-7d34-4dfe-92cc-7c01a855f443', 'volume_name': 'volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7739e9c-b02a-42ad-8d7f-ef08c9bc05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7739e9c-b02a-42ad-8d7f-ef08c9bc05a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c6131-fe92-45f5-949a-d112223339e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:04 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Volume 3256a3fa-7d34-4dfe-92cc-7c01a855f443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443', 'volume_size': 1}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:04 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 1.194s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:04 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 1G
Jul 02 04:54:04 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:05 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4" returned: 0 in 1.200s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f12393b-bfc4-4934-a47b-15c7271d5d74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aabf6d3-111c-4c4d-9c2e-b7f00ff23d32]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:05 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74
Jul 02 04:54:05 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:05 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 1G" returned: 0 in 1.050s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:05 devstack sudo[96550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:05 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:06 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74" returned: 0 in 0.922s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:06 devstack sudo[96556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4
Jul 02 04:54:06 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:06 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 0.947s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:06 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 is being set with open permissions: ugo+rw
Jul 02 04:54:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:06 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:06 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:07 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4" returned: 0 in 1.062s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:07 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4
Jul 02 04:54:07 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:07 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 1.052s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:08 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info
Jul 02 04:54:08 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:08 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74.fed2ceb8-2d33-40d1-9c51-03358b1757f4" returned: 0 in 1.033s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-fed2ceb8-2d33-40d1-9c51-03358b1757f4" released by "_delete_snapshot" :: held 4.410s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" released by "delete_snapshot" :: held 4.476s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Created reservations ['6d9e58bf-d448-43eb-9139-90c1e6320cf9', '1ea84e2c-f5b5-483d-9a78-81c2de2432ad', 'a5769afe-f719-4976-a21d-bad497113cd2', '1e5fd7db-e824-4505-95b1-895fb6f1721c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Delete snapshot completed successfully.
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-caa3d8e4-7f91-422a-b2a0-47e7d0461539 tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-fed2ceb8-2d33-40d1-9c51-03358b1757f4-delete_snapshot" released by "delete_snapshot" :: held 4.643s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:08 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info" returned: 0 in 0.945s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:08 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info is being set with open permissions: ugo+rw
Jul 02 04:54:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:08 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info
Jul 02 04:54:08 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "cinder-2f12393b-bfc4-4934-a47b-15c7271d5d74-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-2f12393b-bfc4-4934-a47b-15c7271d5d74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51941f3a-f374-4460-bf27-21c58867a512]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:09 devstack sudo[96578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74
Jul 02 04:54:09 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:09 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.info" returned: 0 in 0.864s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.190s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.043s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608662492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3256a3fa-7d34-4dfe-92cc-7c01a855f443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:05Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Creating volume 3256a3fa-7d34-4dfe-92cc-7c01a855f443 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:09 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:09 devstack sudo[96581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 1073741824
Jul 02 04:54:09 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-01b935ab-9c56-4bde-9674-09e3790ee9ca tempest-VolumeDependencyTests-1502422027 None] Create snapshot completed successfully
Jul 02 04:54:10 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74" returned: 0 in 1.104s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:10 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74
Jul 02 04:54:10 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:11 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 1073741824" returned: 0 in 1.282s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:11 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443
Jul 02 04:54:11 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Flow 'volume_create_manager' (656a3b4b-0f1c-4f9a-8ed2-ea910d4c3862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db3a2fe-28f9-4e23-aa07-c2cee7008eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db3a2fe-28f9-4e23-aa07-c2cee7008eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-71518620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c437f53e-6643-476f-b6a5-e84b6fdcf546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c538ce27d947d1add8b4113f0055c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e56b7b6-33b0-4169-9174-6043ceb57f02,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:12Z,use_quota=True,user_id='fd0c8240085f4fa089722b4f65a5a78a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a3a472-2a78-483e-b177-a0f93da3796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a3a472-2a78-483e-b177-a0f93da3796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff6b31c-aeb0-4991-a47d-56be8ffba457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff6b31c-aeb0-4991-a47d-56be8ffba457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c437f53e-6643-476f-b6a5-e84b6fdcf546', 'volume_name': 'volume-c437f53e-6643-476f-b6a5-e84b6fdcf546', 'volume_size': 1, 'snapshot_id': '9e56b7b6-33b0-4169-9174-6043ceb57f02'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf13542d-c948-498e-96ba-442919e07fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf13542d-c948-498e-96ba-442919e07fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2093802b-ad82-48f5-a73b-26819b8b85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Volume c437f53e-6643-476f-b6a5-e84b6fdcf546: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c437f53e-6643-476f-b6a5-e84b6fdcf546', 'volume_size': 1, 'snapshot_id': '9e56b7b6-33b0-4169-9174-6043ceb57f02'}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:11 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2f12393b-bfc4-4934-a47b-15c7271d5d74" returned: 0 in 1.181s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-quobyte-2f12393b-bfc4-4934-a47b-15c7271d5d74" released by "delete_volume" :: held 2.353s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Created reservations ['d2cd7a40-7a0a-4037-bec4-8991ce5983c6', '0ecf1f2f-44d4-42e8-bd6b-077f3f4e299d', '96cdcd45-5406-4c70-8368-1ea44f74666f', '5f0f514b-217a-4438-9557-584ef8b5a9bf'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:12 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:12 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:12 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443" returned: 0 in 1.278s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.656s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.612s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02-c437f53e-6643-476f-b6a5-e84b6fdcf546" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c6131-fe92-45f5-949a-d112223339e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8274d-cd74-45ba-b4b2-db5a200cb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02-c437f53e-6643-476f-b6a5-e84b6fdcf546" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Creating volume c437f53e-6643-476f-b6a5-e84b6fdcf546 from snapshot 9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:12 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Volume volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 (3256a3fa-7d34-4dfe-92cc-7c01a855f443): created successfully
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8274d-cd74-45ba-b4b2-db5a200cb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (19e8fc89-62fa-4609-9341-c792984a1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] snapshot: 9e56b7b6-33b0-4169-9174-6043ceb57f02, volume: c437f53e-6643-476f-b6a5-e84b6fdcf546,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:54:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-27ab0761-4017-48fa-82a1-156d26db0f4a tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b4761-0349-457e-9f45-9ef62abd7ff1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:12 devstack sudo[96599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:12 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:13 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.084s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Deleted volume successfully.
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b774256d-0112-474f-9267-3499001ef93a tempest-VolumesSnapshotNegativeTestJSON-1818892367 None] Lock "cinder-2f12393b-bfc4-4934-a47b-15c7271d5d74-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-34e0aab0-5db4-4b90-abd9-9c2a3bf2bedc tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443" by "attach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-34e0aab0-5db4-4b90-abd9-9c2a3bf2bedc tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443" acquired by "attach_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-34e0aab0-5db4-4b90-abd9-9c2a3bf2bedc tempest-VolumesActionsTest-203224824 None] Attaching volume 3256a3fa-7d34-4dfe-92cc-7c01a855f443 to instance bf78e288-0cce-402c-9c02-78aafd9fc108 at mountpoint /dev/vdb on host None.
Jul 02 04:54:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-34e0aab0-5db4-4b90-abd9-9c2a3bf2bedc tempest-VolumesActionsTest-203224824 None] Attach volume completed successfully.
Jul 02 04:54:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-34e0aab0-5db4-4b90-abd9-9c2a3bf2bedc tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443" released by "attach_volume" :: held 0.187s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:14 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 1.668s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71be901-6fb7-4f4b-8727-a961868bdc4e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:14 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:14 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Terminate volume connection completed successfully.
Jul 02 04:54:15 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 0.972s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:15 devstack sudo[96631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546
Jul 02 04:54:15 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" by "detach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Detaching volume 3256a3fa-7d34-4dfe-92cc-7c01a855f443 from instance bf78e288-0cce-402c-9c02-78aafd9fc108.
Jul 02 04:54:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Detach volume completed successfully.
Jul 02 04:54:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-39e418c3-b82e-45ab-b107-c338525e16de tempest-VolumesActionsTest-1607516850 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d092faa6-8bb1-4539-b36c-22637fd93873 tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" by "detach_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d092faa6-8bb1-4539-b36c-22637fd93873 tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d092faa6-8bb1-4539-b36c-22637fd93873 tempest-VolumesActionsTest-203224824 None] Volume detach called, but volume not attached.
Jul 02 04:54:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d092faa6-8bb1-4539-b36c-22637fd93873 tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-quobyte-3256a3fa-7d34-4dfe-92cc-7c01a855f443" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "cinder-quobyte-3256a3fa-7d34-4dfe-92cc-7c01a855f443" acquired by "delete_volume" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639effe-1770-466e-9f86-9d548db7f25b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:17 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443
Jul 02 04:54:17 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:19 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443" returned: 0 in 1.906s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:19 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443
Jul 02 04:54:19 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:21 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3256a3fa-7d34-4dfe-92cc-7c01a855f443" returned: 0 in 1.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "cinder-quobyte-3256a3fa-7d34-4dfe-92cc-7c01a855f443" released by "delete_volume" :: held 3.736s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Created reservations ['d56aff43-2248-4ff5-88d4-9502015762a2', 'b40f4456-5bc7-4a5d-93b5-5e2c68407043', 'a09fd841-ffe2-4f4f-8ba1-528b54a6fbb4', '843a5bac-1564-43a0-a7cf-b9da8d10941f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:21 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:21 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:22 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546" returned: 0 in 6.989s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1915193-ee4c-4c1d-b48f-b325748b491f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:22 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:22 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:22 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.202s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Deleted volume successfully.
Jul 02 04:54:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-073373e5-1003-4b04-8156-3406c5ab05df tempest-VolumesActionsTest-203224824 None] Lock "cinder-3256a3fa-7d34-4dfe-92cc-7c01a855f443-delete_volume" released by "delete_volume" :: held 5.563s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:23 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 1.247s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:23 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:54:23 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Converted 1024.00 MB image at 146.48 MB/s
Jul 02 04:54:23 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 is being set with open permissions: ugo+rw
Jul 02 04:54:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:23 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546
Jul 02 04:54:23 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:24 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546" returned: 0 in 0.848s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" released by "_copy_volume_from_snapshot" :: held 11.904s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02-c437f53e-6643-476f-b6a5-e84b6fdcf546" released by "_create_volume_from_snapshot" :: held 11.991s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.071s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2093802b-ad82-48f5-a73b-26819b8b85a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c437f53e-6643-476f-b6a5-e84b6fdcf546', 'volume_size': 1, 'snapshot_id': '9e56b7b6-33b0-4169-9174-6043ceb57f02'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa27c40f-f045-4fc5-a131-9166c437bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Volume volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 (c437f53e-6643-476f-b6a5-e84b6fdcf546): created successfully
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa27c40f-f045-4fc5-a131-9166c437bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Flow 'volume_create_manager' (656a3b4b-0f1c-4f9a-8ed2-ea910d4c3862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-46efd3f6-ed20-422e-a4a2-1357153eb7f9 tempest-VolumeDependencyTests-1502422027 None] Created volume successfully.
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-9e56b7b6-33b0-4169-9174-6043ceb57f02-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-9e56b7b6-33b0-4169-9174-6043ceb57f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Deleting offline snapshot 9e56b7b6-33b0-4169-9174-6043ceb57f02 of volume 9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] snapshot_file for this snap is: volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cbab7-0f08-4ecb-883b-0aa0e8794455]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:25 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:25 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:26 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 0.901s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:54:26 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[275c0cba-6ab9-4858-87ca-fd502819f5df]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:26 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:26 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:27 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 0.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:27 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:27 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:28 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 0.941s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:28 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02
Jul 02 04:54:28 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:28 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f.9e56b7b6-33b0-4169-9174-6043ceb57f02" returned: 0 in 0.694s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9e56b7b6-33b0-4169-9174-6043ceb57f02" released by "_delete_snapshot" :: held 3.684s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" released by "delete_snapshot" :: held 3.727s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Created reservations ['89814691-aeb9-4fc4-a82d-f238e8a96d82', '631e78f5-54f3-4153-bc58-52b0e7cf86f5', 'fb278e36-951c-41b6-af0d-54999eb8146b', 'd0715ce5-f091-4c51-8602-421ac2237df3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Delete snapshot completed successfully.
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93c5bae1-fc55-4cc6-aab1-86d0d692290b tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-9e56b7b6-33b0-4169-9174-6043ceb57f02-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-9d0e90e5-5e80-47d5-9b73-bbe24c47536f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-9d0e90e5-5e80-47d5-9b73-bbe24c47536f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[717c4c73-7de9-4d46-a354-b8d22c734763]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:29 devstack sudo[96725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:29 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:30 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 0.966s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:30 devstack sudo[96733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f
Jul 02 04:54:30 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:31 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" returned: 0 in 0.853s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-9d0e90e5-5e80-47d5-9b73-bbe24c47536f" released by "delete_volume" :: held 1.892s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Created reservations ['30b4cbe5-c826-41b7-88b1-1e5f64ad3eea', 'b25e32b4-6341-4642-a2cb-2abb11b58a68', '0bc563be-8a9a-4970-a81f-032f9ae1faeb', '28bca93a-6f80-431c-8527-bcd76ea1c87c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:31 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:31 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-c437f53e-6643-476f-b6a5-e84b6fdcf546-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-c437f53e-6643-476f-b6a5-e84b6fdcf546-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06560a2-c574-4d56-909a-175b6e1983eb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:32 devstack sudo[96738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546
Jul 02 04:54:32 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:32 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.046s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Deleted volume successfully.
Jul 02 04:54:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9a768fd-3f16-4a1a-a91d-be7fef9ce087 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-9d0e90e5-5e80-47d5-9b73-bbe24c47536f-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:33 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546" returned: 0 in 1.002s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:33 devstack sudo[96744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546
Jul 02 04:54:33 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:34 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c437f53e-6643-476f-b6a5-e84b6fdcf546" returned: 0 in 0.831s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-quobyte-c437f53e-6643-476f-b6a5-e84b6fdcf546" released by "delete_volume" :: held 1.892s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Created reservations ['79d7fdd2-99fa-4d84-9bba-98858496b18d', '2e6bb5cc-195f-4fcc-ba45-3f7cb2cb41e5', '52e68202-9641-492c-ad72-47a028f0fa69', '36c831c1-afbc-48de-999a-1c8b3249861d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:34 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:34 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:35 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.094s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:35 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Deleted volume successfully.
Jul 02 04:54:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-31570b0c-ab2c-4628-aa9c-bd87436fecf6 tempest-VolumeDependencyTests-1502422027 None] Lock "cinder-c437f53e-6643-476f-b6a5-e84b6fdcf546-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:35 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (fb3a0b62-6492-418d-8981-2c1e97deb51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7f1e0f-4747-470e-a02c-97577766ec60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7f1e0f-4747-470e-a02c-97577766ec60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-671473712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427e076e-9e9a-4c1d-a27c-e80f23a49295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:36Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf624b15-8614-4bed-9b8f-4e3e158edee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf624b15-8614-4bed-9b8f-4e3e158edee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6239bbd-abf2-4018-b944-3be233200a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6239bbd-abf2-4018-b944-3be233200a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427e076e-9e9a-4c1d-a27c-e80f23a49295', 'volume_name': 'volume-427e076e-9e9a-4c1d-a27c-e80f23a49295', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54907dfa-caa6-46c1-9b6d-f2db2df4e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54907dfa-caa6-46c1-9b6d-f2db2df4e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b05a31-b0ad-40cb-987c-b09a6b0efbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Volume 427e076e-9e9a-4c1d-a27c-e80f23a49295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427e076e-9e9a-4c1d-a27c-e80f23a49295', 'volume_size': 1}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-671473712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427e076e-9e9a-4c1d-a27c-e80f23a49295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:36Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Creating volume 427e076e-9e9a-4c1d-a27c-e80f23a49295 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:36 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:36 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 1073741824
Jul 02 04:54:36 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:37 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 1073741824" returned: 0 in 1.184s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:37 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295
Jul 02 04:54:37 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:38 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295" returned: 0 in 0.902s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b05a31-b0ad-40cb-987c-b09a6b0efbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427e076e-9e9a-4c1d-a27c-e80f23a49295', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83a4e0c-7407-4410-a32d-c149c8f55a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:38 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Volume volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 (427e076e-9e9a-4c1d-a27c-e80f23a49295): created successfully
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83a4e0c-7407-4410-a32d-c149c8f55a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (fb3a0b62-6492-418d-8981-2c1e97deb51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:38 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-77257053-58bc-44f6-946a-3a31897c9af9 tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-427e076e-9e9a-4c1d-a27c-e80f23a49295-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-427e076e-9e9a-4c1d-a27c-e80f23a49295-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-quobyte-427e076e-9e9a-4c1d-a27c-e80f23a49295" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-427e076e-9e9a-4c1d-a27c-e80f23a49295" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137e5a7-0c0c-44ab-95d7-1699669d9aac]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:39 devstack sudo[96765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295
Jul 02 04:54:39 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:40 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295" returned: 0 in 0.969s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:40 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295
Jul 02 04:54:40 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:41 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-427e076e-9e9a-4c1d-a27c-e80f23a49295" returned: 0 in 0.754s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-427e076e-9e9a-4c1d-a27c-e80f23a49295" released by "delete_volume" :: held 1.778s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Created reservations ['4e4899da-e8f8-4ecc-b570-945c0f4f305a', '3767a8c2-6091-41e4-b637-eca314f25907', '83185999-27e2-4904-9516-75f2678d5fd3', 'd3fb26f7-4767-4333-9ca9-87517872976d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:41 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:41 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:42 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.198s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:42 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Deleted volume successfully.
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46b1b1ea-ab8e-4ad0-818f-96ebfe58d51e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-427e076e-9e9a-4c1d-a27c-e80f23a49295-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (ebefa9f6-a150-4b2e-9cec-dbf8aa5e5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67230fbc-0fe9-4737-8db0-9e7704e995e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67230fbc-0fe9-4737-8db0-9e7704e995e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465750863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771af9b4-b434-463b-9cfc-35d9059912d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:43Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73db80d8-b18d-49dc-95aa-7aa5f4d7860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73db80d8-b18d-49dc-95aa-7aa5f4d7860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a91e763-dd87-4a71-903e-8445b9c68d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a91e763-dd87-4a71-903e-8445b9c68d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771af9b4-b434-463b-9cfc-35d9059912d9', 'volume_name': 'volume-771af9b4-b434-463b-9cfc-35d9059912d9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1876af-f5c3-43da-99a9-86416e2844d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1876af-f5c3-43da-99a9-86416e2844d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766b5f2-72c9-40d4-a6b8-66959df0005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:42 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Volume 771af9b4-b434-463b-9cfc-35d9059912d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771af9b4-b434-463b-9cfc-35d9059912d9', 'volume_size': 1}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1465750863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771af9b4-b434-463b-9cfc-35d9059912d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:43Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Creating volume 771af9b4-b434-463b-9cfc-35d9059912d9 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:42 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:42 devstack sudo[96784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 1073741824
Jul 02 04:54:42 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:44 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 1073741824" returned: 0 in 1.096s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:44 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9
Jul 02 04:54:44 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:45 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9" returned: 0 in 0.947s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766b5f2-72c9-40d4-a6b8-66959df0005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771af9b4-b434-463b-9cfc-35d9059912d9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea67deee-02e4-4fe0-8f68-e3a1eb4edb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:45 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Volume volume-771af9b4-b434-463b-9cfc-35d9059912d9 (771af9b4-b434-463b-9cfc-35d9059912d9): created successfully
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea67deee-02e4-4fe0-8f68-e3a1eb4edb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (ebefa9f6-a150-4b2e-9cec-dbf8aa5e5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-95314249-5abd-4faf-86fc-6b1765fce0a4 tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-771af9b4-b434-463b-9cfc-35d9059912d9-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-771af9b4-b434-463b-9cfc-35d9059912d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-quobyte-771af9b4-b434-463b-9cfc-35d9059912d9" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-771af9b4-b434-463b-9cfc-35d9059912d9" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[750996ce-2a6a-4886-8c46-12229f3777c8]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:46 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9
Jul 02 04:54:46 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:47 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9" returned: 0 in 0.970s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:47 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9
Jul 02 04:54:47 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:48 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-771af9b4-b434-463b-9cfc-35d9059912d9" returned: 0 in 0.855s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-771af9b4-b434-463b-9cfc-35d9059912d9" released by "delete_volume" :: held 1.886s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=90,cinder:INSERT=24,cinder:UPDATE=94,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=70,cinder:INSERT=26,cinder:UPDATE=108,cinder:DELETE=12 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Created reservations ['fb6820d1-eef4-4172-9ed0-6f8555307e27', '870593bc-d68b-41f7-beaf-b2b2cbecc389', '4c5a9a0c-7a1a-4c95-81aa-91bd50122032', '61ba21a5-b696-4374-ba13-15510961f003'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:48 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:48 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Flow 'volume_create_manager' (5f08f1eb-c825-4016-89c4-2716a604f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0d6a76-ab28-4e4c-a3a5-ff2611f65468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0d6a76-ab28-4e4c-a3a5-ff2611f65468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-726824858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfeb1d2-9418-4605-963c-e5c5a816cd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c18cd4a93c451abb7baaeba11d0a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:49Z,use_quota=True,user_id='144af6627465442ab644dc604f42f879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acaa950-7197-4a86-a964-b1aaf2a442b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acaa950-7197-4a86-a964-b1aaf2a442b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84002b95-a798-4c89-b6b7-263c2800350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84002b95-a798-4c89-b6b7-263c2800350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfeb1d2-9418-4605-963c-e5c5a816cd6f', 'volume_name': 'volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04619686-0a7d-4df8-be2b-f0ab8d43efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04619686-0a7d-4df8-be2b-f0ab8d43efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df691fc-97b6-49d8-9003-1d4fe80940fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:48 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume 4cfeb1d2-9418-4605-963c-e5c5a816cd6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f', 'volume_size': 1}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-726824858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfeb1d2-9418-4605-963c-e5c5a816cd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c18cd4a93c451abb7baaeba11d0a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:49Z,use_quota=True,user_id='144af6627465442ab644dc604f42f879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Creating volume 4cfeb1d2-9418-4605-963c-e5c5a816cd6f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:48 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:48 devstack sudo[96859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f 1073741824
Jul 02 04:54:48 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Flow 'volume_create_manager' (326119eb-b88a-4c79-b273-18ad507320e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297c4589-5d51-4b82-9968-ae2489eac040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297c4589-5d51-4b82-9968-ae2489eac040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1608361474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bf75e1-fbed-4c6c-9f54-03104c2aace8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c18cd4a93c451abb7baaeba11d0a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:49Z,use_quota=True,user_id='144af6627465442ab644dc604f42f879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f56356e-3ebd-4436-8ec9-a4384bae5b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f56356e-3ebd-4436-8ec9-a4384bae5b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095bbebc-fe6e-4964-94ab-7dbfa8d5072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095bbebc-fe6e-4964-94ab-7dbfa8d5072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29bf75e1-fbed-4c6c-9f54-03104c2aace8', 'volume_name': 'volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c5dc7-ce75-4166-abb0-e1e0bf7b2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c5dc7-ce75-4166-abb0-e1e0bf7b2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5530d6-7779-42f0-8db5-5d1890cbbf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume 29bf75e1-fbed-4c6c-9f54-03104c2aace8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8', 'volume_size': 1}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.360s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Deleted volume successfully.
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4a5777ad-920d-4242-bdfb-b0195981787e tempest-VolumesActionsTest-1607516850 None] Lock "cinder-771af9b4-b434-463b-9cfc-35d9059912d9-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (436b0981-4cd9-4dfd-8c5a-0f03c307d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1816ed6d-f974-4d90-aaa3-9c465b8c5ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1816ed6d-f974-4d90-aaa3-9c465b8c5ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1330270530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:50Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e185953-3d0b-4cb3-85d2-395d928b4acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e185953-3d0b-4cb3-85d2-395d928b4acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3d9cbe-4232-4967-90b4-fa41fa174020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3d9cbe-4232-4967-90b4-fa41fa174020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc', 'volume_name': 'volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60886728-a8cf-4875-8942-68bd73266512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60886728-a8cf-4875-8942-68bd73266512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6ca1d7-589e-4245-935d-c8ea26f00eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Volume cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc', 'volume_size': 1}
Jul 02 04:54:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:50 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f 1073741824" returned: 0 in 1.328s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:50 devstack sudo[96867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f
Jul 02 04:54:50 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:50 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" returned: 0 in 0.772s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1608361474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bf75e1-fbed-4c6c-9f54-03104c2aace8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c18cd4a93c451abb7baaeba11d0a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:49Z,use_quota=True,user_id='144af6627465442ab644dc604f42f879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Creating volume 29bf75e1-fbed-4c6c-9f54-03104c2aace8 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:51 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df691fc-97b6-49d8-9003-1d4fe80940fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:51 devstack sudo[96871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 1073741824
Jul 02 04:54:51 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ed69c4-64bd-4341-821f-2e2303a514dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f (4cfeb1d2-9418-4605-963c-e5c5a816cd6f): created successfully
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ed69c4-64bd-4341-821f-2e2303a514dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Flow 'volume_create_manager' (5f08f1eb-c825-4016-89c4-2716a604f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-40e19554-5b41-4763-bfd5-8b798d200ffd tempest-TestServerVolumeAttachmentScenario-1087467154 None] Created volume successfully.
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:51 devstack sudo[96878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:51 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:52 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 1073741824" returned: 0 in 1.130s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:52 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8
Jul 02 04:54:52 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:52 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.920s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:54:52 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8" returned: 0 in 0.797s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.097s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1330270530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:54:50Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Creating volume cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:54:53 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:53 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc 1073741824
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5530d6-7779-42f0-8db5-5d1890cbbf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:53 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b817f9-41fd-40e2-a367-2b8f9006c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Volume volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 (29bf75e1-fbed-4c6c-9f54-03104c2aace8): created successfully
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b817f9-41fd-40e2-a367-2b8f9006c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Flow 'volume_create_manager' (326119eb-b88a-4c79-b273-18ad507320e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1c852420-bbb3-4c2a-b26a-26e18444d549 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Created volume successfully.
Jul 02 04:54:54 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc 1073741824" returned: 0 in 1.208s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:54 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc
Jul 02 04:54:54 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:55 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" returned: 0 in 0.844s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6ca1d7-589e-4245-935d-c8ea26f00eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7547241b-fd2e-413d-bc60-2db812469d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:54:55 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Volume volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc (cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc): created successfully
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7547241b-fd2e-413d-bc60-2db812469d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:54:55 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (436b0981-4cd9-4dfd-8c5a-0f03c307d462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:54:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3efd7737-097f-4c16-beee-09de13d56949 tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-quobyte-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2470021-7056-4ee0-b0e9-3a0ba98153cd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:54:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:57 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc
Jul 02 04:54:57 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:57 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" returned: 0 in 1.236s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:58 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc
Jul 02 04:54:58 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:58 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc" released by "delete_volume" :: held 2.065s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Created reservations ['0f0994ae-3927-4e1c-92e9-7f7a425722c2', '6e596597-7ede-44c6-ab56-838fad1b5b48', '8489a6a6-7976-44fe-b58a-476bf7c6eedb', '2eaf7567-e678-4368-9a54-3fdc621bd298'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:54:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:54:58 devstack sudo[96971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:54:58 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:54:59 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root
Jul 02 04:54:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.753s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:54:59 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:54:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Deleted volume successfully.
Jul 02 04:54:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ea69647a-97d9-416f-ad6d-cb4e300eccb3 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-cb3748bd-d1e8-4fa8-b263-3d3f48d46ffc-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (e6f64922-43f9-4d09-a37d-83f0787e7009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6340b219-e3a3-4129-bc9a-a82774c19171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6340b219-e3a3-4129-bc9a-a82774c19171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-932420126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:01Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda5f040-7c26-4851-baab-3ec07dc0ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda5f040-7c26-4851-baab-3ec07dc0ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b8a53-6f59-46a4-8887-d4ab9f1ddf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b8a53-6f59-46a4-8887-d4ab9f1ddf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef', 'volume_name': 'volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414e2325-d5d5-49ba-8d4b-f55b2b0c1e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414e2325-d5d5-49ba-8d4b-f55b2b0c1e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689aa87-c128-4754-be45-8020da7238c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:00 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Volume c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef', 'volume_size': 1}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-932420126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:01Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Creating volume c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:00 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:00 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef 1073741824
Jul 02 04:55:00 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:01 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef 1073741824" returned: 0 in 1.173s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:02 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef
Jul 02 04:55:02 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:02 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" returned: 0 in 0.762s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689aa87-c128-4754-be45-8020da7238c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8b8bff-ef32-49bb-a142-75ed9c174da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:02 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Volume volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef (c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef): created successfully
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8b8bff-ef32-49bb-a142-75ed9c174da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (e6f64922-43f9-4d09-a37d-83f0787e7009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-508cbbdc-15af-4f5e-ba24-026f6857a043 tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "cinder-quobyte-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b0cfb-e34f-4b76-8de3-ddc0d46fa1fa]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:04 devstack sudo[97007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef
Jul 02 04:55:04 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:06 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" returned: 0 in 1.659s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:06 devstack sudo[97261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef
Jul 02 04:55:06 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:08 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" returned: 0 in 2.056s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-quobyte-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef" released by "delete_volume" :: held 3.811s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Created reservations ['a438a36d-84db-4b7e-8eb9-c59b64208be9', '7104cfba-546e-417f-bc0c-9fc3ff673c48', '9a9da9d6-6746-46dd-8575-54e3f8d2f271', '04a0e2a4-89e8-49d8-96f2-96adcb87a081'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:08 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:08 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Flow 'volume_create_manager' (f88df6ed-e23e-4f91-9413-5b2a674e889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbe2149-c911-4547-a557-2de180b523cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbe2149-c911-4547-a557-2de180b523cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-647200437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d53f51d-dd16-47b4-8114-32d93f3001c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518e9f977acb44088cb8122ef3957ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:09Z,use_quota=True,user_id='44e83fd130354ff496ec5a0a465e08b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e42e18-e875-41a7-9ada-f48c4c329cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e42e18-e875-41a7-9ada-f48c4c329cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a906af92-9671-4c88-a3d8-d98a42e64edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a906af92-9671-4c88-a3d8-d98a42e64edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d53f51d-dd16-47b4-8114-32d93f3001c9', 'volume_name': 'volume-2d53f51d-dd16-47b4-8114-32d93f3001c9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee20d6e-de6f-4daf-8538-260ffc87344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee20d6e-de6f-4daf-8538-260ffc87344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee43658-1cdb-4add-91a4-bb1161350af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:09 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Volume 2d53f51d-dd16-47b4-8114-32d93f3001c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d53f51d-dd16-47b4-8114-32d93f3001c9', 'volume_size': 1}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-647200437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d53f51d-dd16-47b4-8114-32d93f3001c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518e9f977acb44088cb8122ef3957ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:09Z,use_quota=True,user_id='44e83fd130354ff496ec5a0a465e08b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Creating volume 2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:09 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:09 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 1073741824
Jul 02 04:55:09 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:10 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.993s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:10 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Deleted volume successfully.
Jul 02 04:55:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e20f966f-ddd4-4159-8166-e7d09761f7a5 tempest-VolumesActionsTest-1607516850 None] Lock "cinder-c0a884a7-b21a-4b11-b9d5-9e1fa9ad20ef-delete_volume" released by "delete_volume" :: held 6.488s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (19c15136-3d98-4be2-9a9f-0a28b044b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b639f0-e301-4105-b290-f19cf99cc9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b639f0-e301-4105-b290-f19cf99cc9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1756139818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc854e3-8f26-4265-ba9b-105145038b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:11Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd571494-79e7-447e-8fbf-868e87744b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd571494-79e7-447e-8fbf-868e87744b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5efb4-8dd4-4a21-92d0-581b95fc13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5efb4-8dd4-4a21-92d0-581b95fc13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc854e3-8f26-4265-ba9b-105145038b4f', 'volume_name': 'volume-3fc854e3-8f26-4265-ba9b-105145038b4f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50bb896-54b1-497f-83c0-765f76cc7ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50bb896-54b1-497f-83c0-765f76cc7ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22229f4-c975-402a-92d8-f9557b45c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Volume 3fc854e3-8f26-4265-ba9b-105145038b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc854e3-8f26-4265-ba9b-105145038b4f', 'volume_size': 1}
Jul 02 04:55:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:12 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 1073741824" returned: 0 in 2.642s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:12 devstack sudo[97427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:12 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:13 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 0.930s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] <== create_volume: return (3692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.719s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1756139818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc854e3-8f26-4265-ba9b-105145038b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ceb02b17404c75b57a5dd9931cd90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:11Z,use_quota=True,user_id='eda3cf29adec4792a4b32845c4d173ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Creating volume 3fc854e3-8f26-4265-ba9b-105145038b4f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:13 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:13 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f 1073741824
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee43658-1cdb-4add-91a4-bb1161350af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d53f51d-dd16-47b4-8114-32d93f3001c9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:13 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a02621-4537-4d69-8fc8-2a17981f4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:13 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Volume volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 (2d53f51d-dd16-47b4-8114-32d93f3001c9): created successfully
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a02621-4537-4d69-8fc8-2a17981f4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Flow 'volume_create_manager' (f88df6ed-e23e-4f91-9413-5b2a674e889c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c0a70d1a-1e73-4423-9247-0c908fbd26d0 tempest-SnapshotDependencyTests-2129849622 None] Created volume successfully.
Jul 02 04:55:14 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f 1073741824" returned: 0 in 1.408s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:14 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f
Jul 02 04:55:14 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:15 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f" returned: 0 in 1.067s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.843s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Creating offline snapshot ee2ff3ad-5286-4efc-8e5e-eda322707dcd of volume 2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22229f4-c975-402a-92d8-f9557b45c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc854e3-8f26-4265-ba9b-105145038b4f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f47d48-021a-4b11-a67d-bc4ca35aedc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e4f58-27de-4719-bd7a-11125bf0b075]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:16 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Volume volume-3fc854e3-8f26-4265-ba9b-105145038b4f (3fc854e3-8f26-4265-ba9b-105145038b4f): created successfully
Jul 02 04:55:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f47d48-021a-4b11-a67d-bc4ca35aedc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Flow 'volume_create_manager' (19c15136-3d98-4be2-9a9f-0a28b044b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2db0c590-d9ac-4d5d-8488-ad75f258d4fc tempest-VolumesActionsTest-203224824 None] Created volume successfully.
Jul 02 04:55:16 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:16 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:17 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 1.041s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:17 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd 1G
Jul 02 04:55:17 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-3fc854e3-8f26-4265-ba9b-105145038b4f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "cinder-3fc854e3-8f26-4265-ba9b-105145038b4f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Acquiring lock "cinder-quobyte-3fc854e3-8f26-4265-ba9b-105145038b4f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "cinder-quobyte-3fc854e3-8f26-4265-ba9b-105145038b4f" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[500474c9-9f1f-4880-a2b5-7f93e92c687e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:17 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f
Jul 02 04:55:17 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:18 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd 1G" returned: 0 in 1.004s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:18 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:18 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:18 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f" returned: 0 in 0.808s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:18 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f
Jul 02 04:55:18 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:18 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:18 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd is being set with open permissions: ugo+rw
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:18 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:18 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:18 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-3fc854e3-8f26-4265-ba9b-105145038b4f" returned: 0 in 0.666s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "cinder-quobyte-3fc854e3-8f26-4265-ba9b-105145038b4f" released by "delete_volume" :: held 1.555s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Created reservations ['a134b7b5-bd79-4440-81dd-98f9f38d80c8', '70d441d8-1043-457b-8b41-5c3b2310064a', 'f6c106ca-3519-413f-ad9a-8c2cfae6ae01', 'c8c7babb-f674-48e2-bdb8-e18d04b2e45d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:19 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:19 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:19 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.806s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:19 devstack sudo[97584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info
Jul 02 04:55:19 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:20 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.923s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:20 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:20 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Deleted volume successfully.
Jul 02 04:55:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571133d0-493d-40ac-8a8d-eb48e94c3add tempest-VolumesActionsTest-203224824 None] Lock "cinder-3fc854e3-8f26-4265-ba9b-105145038b4f-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:20 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info" returned: 0 in 0.971s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:20 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info is being set with open permissions: ugo+rw
Jul 02 04:55:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:20 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info
Jul 02 04:55:20 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:21 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.info" returned: 0 in 0.710s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-aeaf7517-4480-4f81-8b1b-08925e5343a6 tempest-SnapshotDependencyTests-2129849622 None] Create snapshot completed successfully
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Flow 'volume_create_manager' (fca8bfec-ba5e-4677-b06b-787086da929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b82982-b95e-4c7a-ad60-9df28abf8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b82982-b95e-4c7a-ad60-9df28abf8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e0fbc-b8cd-41b3-844b-ac412466b4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518e9f977acb44088cb8122ef3957ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee2ff3ad-5286-4efc-8e5e-eda322707dcd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:23Z,use_quota=True,user_id='44e83fd130354ff496ec5a0a465e08b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a384c65-5019-4f39-8a53-e180093a8e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a384c65-5019-4f39-8a53-e180093a8e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ce9b8e-4f56-49dd-91ae-98239235c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ce9b8e-4f56-49dd-91ae-98239235c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e37e0fbc-b8cd-41b3-844b-ac412466b4a0', 'volume_name': 'volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0', 'volume_size': 1, 'snapshot_id': 'ee2ff3ad-5286-4efc-8e5e-eda322707dcd'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a3406b-3d24-481a-8978-92ae4c2d3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a3406b-3d24-481a-8978-92ae4c2d3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3662f81d-111c-493b-a815-07ee966d30c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:23 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Volume e37e0fbc-b8cd-41b3-844b-ac412466b4a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0', 'volume_size': 1, 'snapshot_id': 'ee2ff3ad-5286-4efc-8e5e-eda322707dcd'}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Creating volume e37e0fbc-b8cd-41b3-844b-ac412466b4a0 from snapshot ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] snapshot: ee2ff3ad-5286-4efc-8e5e-eda322707dcd, volume: e37e0fbc-b8cd-41b3-844b-ac412466b4a0,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be3efa4-12c9-446e-b53d-6a01db0ac403]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:23 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:23 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:24 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.875s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d53f51d-dd16-47b4-8114-32d93f3001c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[641832cf-665a-4faf-804e-446301467256]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:24 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:24 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:25 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 0.825s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:25 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 04:55:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:25 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0
Jul 02 04:55:25 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (946c877f-906e-4bf2-a4ad-33764e1c1079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ecd7b5-9754-4cb9-bbf3-24cd57d05c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ecd7b5-9754-4cb9-bbf3-24cd57d05c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1560209354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9612085d-d97c-43ae-97f4-822000a6900d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:28Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6559a1-a6b6-476b-ac5c-f3282940a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6559a1-a6b6-476b-ac5c-f3282940a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66897d64-5052-4e27-83a7-ff210c634491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66897d64-5052-4e27-83a7-ff210c634491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9612085d-d97c-43ae-97f4-822000a6900d', 'volume_name': 'volume-9612085d-d97c-43ae-97f4-822000a6900d', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40793bf4-c6d8-4af8-bcc2-2f0bfaf32bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40793bf4-c6d8-4af8-bcc2-2f0bfaf32bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79c7fe9-ee44-46a4-bb6c-fde6312d5d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Volume 9612085d-d97c-43ae-97f4-822000a6900d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9612085d-d97c-43ae-97f4-822000a6900d', 'volume_size': 1}
Jul 02 04:55:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:31 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" returned: 0 in 6.209s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf25a1c8-b437-4f92-9d6d-891695e806f5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:31 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:31 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:32 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 1.032s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:32 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:55:32 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Converted 1024.00 MB image at 164.89 MB/s
Jul 02 04:55:32 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 is being set with open permissions: ugo+rw
Jul 02 04:55:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:32 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0
Jul 02 04:55:32 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:33 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" returned: 0 in 0.650s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" released by "_copy_volume_from_snapshot" :: held 9.710s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" released by "_create_volume_from_snapshot" :: held 9.739s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.758s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.312s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1560209354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9612085d-d97c-43ae-97f4-822000a6900d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:28Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Creating volume 9612085d-d97c-43ae-97f4-822000a6900d {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:33 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:33 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d 1073741824
Jul 02 04:55:33 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3662f81d-111c-493b-a815-07ee966d30c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0', 'volume_size': 1, 'snapshot_id': 'ee2ff3ad-5286-4efc-8e5e-eda322707dcd'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef78e7ff-ba60-483f-9edf-03fae03ca469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Volume volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 (e37e0fbc-b8cd-41b3-844b-ac412466b4a0): created successfully
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef78e7ff-ba60-483f-9edf-03fae03ca469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Flow 'volume_create_manager' (fca8bfec-ba5e-4677-b06b-787086da929e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6202604c-6dab-490d-baab-ddad96afe8aa tempest-SnapshotDependencyTests-2129849622 None] Created volume successfully.
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Deleting offline snapshot ee2ff3ad-5286-4efc-8e5e-eda322707dcd of volume 2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] snapshot_file for this snap is: volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d12183-f4d5-496a-aa71-b41dc3616000]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:33 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:33 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:34 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d 1073741824" returned: 0 in 0.899s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:34 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d
Jul 02 04:55:34 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:34 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d53f51d-dd16-47b4-8114-32d93f3001c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c611b2-ee71-423a-9179-cbb8825145cd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:34 devstack sudo[97688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:34 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:34 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d" returned: 0 in 0.710s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79c7fe9-ee44-46a4-bb6c-fde6312d5d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9612085d-d97c-43ae-97f4-822000a6900d', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c91f9ad-0964-4c2a-bb4a-0edf068145f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Volume volume-9612085d-d97c-43ae-97f4-822000a6900d (9612085d-d97c-43ae-97f4-822000a6900d): created successfully
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c91f9ad-0964-4c2a-bb4a-0edf068145f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (946c877f-906e-4bf2-a4ad-33764e1c1079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-62ece149-dfd2-4c2f-bf0b-e75e1d3cc536 tempest-AttachVolumeTestJSON-856083775 None] Created volume successfully.
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (c1d2dd6f-571f-4c74-8e86-14e8c7382a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3bec0b-c531-4024-871f-eb231acfa7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3bec0b-c531-4024-871f-eb231acfa7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-161151431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c743012-bea5-43ec-9c4a-f8d5dcbea529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:35Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae5065e-eba9-44fa-ab8f-0dc8156f092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae5065e-eba9-44fa-ab8f-0dc8156f092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a492e7d-56ff-4bce-83d7-14c63bc5373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a492e7d-56ff-4bce-83d7-14c63bc5373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c743012-bea5-43ec-9c4a-f8d5dcbea529', 'volume_name': 'volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2575551-d418-4e50-beed-42aa38c27f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2575551-d418-4e50-beed-42aa38c27f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46adc5c-1d6a-4285-9d99-3eb40e2c5b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Volume 8c743012-bea5-43ec-9c4a-f8d5dcbea529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529', 'volume_size': 1}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-161151431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c743012-bea5-43ec-9c4a-f8d5dcbea529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:35Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Creating volume 8c743012-bea5-43ec-9c4a-f8d5dcbea529 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:35 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 0.928s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:35 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 1073741824
Jul 02 04:55:35 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:35 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:35 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:36 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.802s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:36 devstack sudo[97710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd
Jul 02 04:55:36 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:36 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 1073741824" returned: 0 in 0.949s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:36 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529
Jul 02 04:55:36 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:37 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9.ee2ff3ad-5286-4efc-8e5e-eda322707dcd" returned: 0 in 0.700s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-ee2ff3ad-5286-4efc-8e5e-eda322707dcd" released by "_delete_snapshot" :: held 3.468s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" released by "delete_snapshot" :: held 3.492s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Created reservations ['636f7f46-3bcd-43a7-a8ab-ffa50095a8d1', '519c17be-48c9-45fe-93cb-35c9f97b4430', '7c7afac1-014a-4465-b950-0124062c0248', 'bc98225a-dccf-4d68-a6ad-69a9030e8efe'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:37 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529" returned: 0 in 0.664s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46adc5c-1d6a-4285-9d99-3eb40e2c5b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ff14a-8db7-4b03-b79a-ce7b4b5df404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Volume volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 (8c743012-bea5-43ec-9c4a-f8d5dcbea529): created successfully
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ff14a-8db7-4b03-b79a-ce7b4b5df404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (c1d2dd6f-571f-4c74-8e86-14e8c7382a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Delete snapshot completed successfully.
Jul 02 04:55:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1ae087ff-da21-4a09-abaf-1307a81fba0b tempest-VolumesListAdminTestJSON-191541105 None] Created volume successfully.
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-9fb837ae-88fb-4d1b-a872-b1267412d4e9 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-ee2ff3ad-5286-4efc-8e5e-eda322707dcd-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-2d53f51d-dd16-47b4-8114-32d93f3001c9-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-2d53f51d-dd16-47b4-8114-32d93f3001c9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6036dee-c65d-4aaf-87ca-892d7eb2d2d3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (ab372144-d98e-4ad6-afa9-dcc53ccffee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828a09e-20b3-4675-9c76-a908a9d66cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:38 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:38 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828a09e-20b3-4675-9c76-a908a9d66cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373153882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:38Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839137ec-9ac9-44d1-850a-dcdff82c2bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839137ec-9ac9-44d1-850a-dcdff82c2bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bf4b45-d27d-46e5-8fbf-63175f3b4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bf4b45-d27d-46e5-8fbf-63175f3b4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105', 'volume_name': 'volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861c40c-0495-4a51-911d-6d9add12b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861c40c-0495-4a51-911d-6d9add12b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b56bd2-5e4d-4952-b1f6-add3df6e9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:38 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Volume 60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105', 'volume_size': 1}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373153882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:38Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Creating volume 60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:38 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:38 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 1073741824
Jul 02 04:55:38 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:38 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 0.837s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:38 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9
Jul 02 04:55:38 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:39 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 1073741824" returned: 0 in 0.936s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:39 devstack sudo[97740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105
Jul 02 04:55:39 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:39 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d53f51d-dd16-47b4-8114-32d93f3001c9" returned: 0 in 0.684s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-2d53f51d-dd16-47b4-8114-32d93f3001c9" released by "delete_volume" :: held 1.597s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Created reservations ['13703336-2e58-446a-a712-733f107e33da', '2f1f3784-7584-4aa1-b372-7476e6825910', '01a7dafc-b881-40fa-bf30-e51463a04017', '4e931eef-b959-47d1-9253-195275fc25fc'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:39 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:39 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:39 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" returned: 0 in 0.680s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.573s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b56bd2-5e4d-4952-b1f6-add3df6e9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd96e92-558b-4d9c-a9c1-1e4a48e04820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50989c3-f6a6-4124-9d0e-e05f10923bad]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Volume volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 (60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105): created successfully
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd96e92-558b-4d9c-a9c1-1e4a48e04820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (ab372144-d98e-4ad6-afa9-dcc53ccffee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-efbde91a-9c28-4033-87c6-1c9785cc9261 tempest-VolumesListAdminTestJSON-191541105 None] Created volume successfully.
Jul 02 04:55:40 devstack sudo[97754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d
Jul 02 04:55:40 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:40 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.656s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Deleted volume successfully.
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-571980ba-07d6-4ae9-8cf8-55e4f1f82cda tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-2d53f51d-dd16-47b4-8114-32d93f3001c9-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:40 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d" returned: 0 in 0.765s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.951s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3dcca-fb42-44ea-bc2d-e549718ed7fd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-9612085d-d97c-43ae-97f4-822000a6900d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3febd3d5-6bbf-44d4-b93f-a3d2777dd029', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:55:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-fd7d098f-4dc5-40a5-b576-1b787c89c285 req-41c72e6f-23f4-4ade-b306-425345e1d1aa tempest-AttachVolumeTestJSON-856083775 None] attachment_update completed successfully.
Jul 02 04:55:40 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f
Jul 02 04:55:40 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-e37e0fbc-b8cd-41b3-844b-ac412466b4a0-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-e37e0fbc-b8cd-41b3-844b-ac412466b4a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fcf47e-44ef-4090-94f3-227b722d18fb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:41 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0
Jul 02 04:55:41 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:41 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" returned: 0 in 0.836s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3378ecd9-2f67-47f2-8dc9-fd24f5497a11', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:55:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-0907a243-7406-43ed-9712-e29bfbd18cab req-cbb2f3ca-ec1d-4512-adac-17be09ed7a3d tempest-TestServerVolumeAttachmentScenario-1087467154 None] attachment_update completed successfully.
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (53275f75-1ac2-41cb-be18-a500019334b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8061ab1-5fca-468a-8732-dd9a40c4fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8061ab1-5fca-468a-8732-dd9a40c4fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-117549388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1717c7d9-5682-41c2-8d96-9283f5944b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:42Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47edcda-b525-4722-8598-f159c7dbdd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47edcda-b525-4722-8598-f159c7dbdd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241e015f-ff86-4138-b6bb-7d781829884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241e015f-ff86-4138-b6bb-7d781829884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1717c7d9-5682-41c2-8d96-9283f5944b4e', 'volume_name': 'volume-1717c7d9-5682-41c2-8d96-9283f5944b4e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb39f0de-f22e-4e97-99e5-eb569ce12aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb39f0de-f22e-4e97-99e5-eb569ce12aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869fb129-fa8e-4a1f-bf4a-2fbfcaaae8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:41 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Volume 1717c7d9-5682-41c2-8d96-9283f5944b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1717c7d9-5682-41c2-8d96-9283f5944b4e', 'volume_size': 1}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-117549388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1717c7d9-5682-41c2-8d96-9283f5944b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e53b56d9f0b4581a642b83916d00036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:42Z,use_quota=True,user_id='1582b897033a4441b3850351331983bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Creating volume 1717c7d9-5682-41c2-8d96-9283f5944b4e {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:41 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:41 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e 1073741824
Jul 02 04:55:41 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:42 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" returned: 0 in 0.852s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:42 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0
Jul 02 04:55:42 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:42 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e 1073741824" returned: 0 in 0.892s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:42 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" returned: 0 in 0.681s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-quobyte-e37e0fbc-b8cd-41b3-844b-ac412466b4a0" released by "delete_volume" :: held 1.589s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:42 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e
Jul 02 04:55:42 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Created reservations ['169016af-20dd-461b-bd78-62ae518a48fd', '990635e0-f5ba-44b3-819f-8bf39469c748', 'c96bd2d4-9100-4d83-ae95-d1c8c745a145', '0b79534e-a0b6-43e3-a04d-db1c1817f3f9'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:42 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:42 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:43 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e" returned: 0 in 0.662s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869fb129-fa8e-4a1f-bf4a-2fbfcaaae8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1717c7d9-5682-41c2-8d96-9283f5944b4e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911bfc99-6eed-451d-8ef4-0c08c3644165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Volume volume-1717c7d9-5682-41c2-8d96-9283f5944b4e (1717c7d9-5682-41c2-8d96-9283f5944b4e): created successfully
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911bfc99-6eed-451d-8ef4-0c08c3644165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Flow 'volume_create_manager' (53275f75-1ac2-41cb-be18-a500019334b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-dd7139e5-9ae0-4c41-b61f-ca0388ca3b62 tempest-VolumesListAdminTestJSON-191541105 None] Created volume successfully.
Jul 02 04:55:43 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.675s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Deleted volume successfully.
Jul 02 04:55:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-53d2c937-0e8e-475c-bdbe-ad73ca710c67 tempest-SnapshotDependencyTests-2129849622 None] Lock "cinder-e37e0fbc-b8cd-41b3-844b-ac412466b4a0-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Flow 'volume_create_manager' (1073d5e3-29fa-4fdc-8f4e-1d7ca5e8b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51cf7fd-b839-4a08-a32e-10fda425a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51cf7fd-b839-4a08-a32e-10fda425a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6652f1-18ff-4741-9532-fbf168f835b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdaa8dda9fb4d0cb91fbe0a4b7ddbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:44Z,use_quota=True,user_id='e4968fc628a6457982dc2b333dfad378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bca5ba-98c9-4b81-b866-38bf54b60aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bca5ba-98c9-4b81-b866-38bf54b60aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84132380-d007-40ff-9281-d4d510335f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84132380-d007-40ff-9281-d4d510335f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6652f1-18ff-4741-9532-fbf168f835b2', 'volume_name': 'volume-fc6652f1-18ff-4741-9532-fbf168f835b2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57eaf60-cc93-4055-98e2-30af44cfea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57eaf60-cc93-4055-98e2-30af44cfea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013944b-0017-4be4-89f9-37d4d7010235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:44 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Volume fc6652f1-18ff-4741-9532-fbf168f835b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6652f1-18ff-4741-9532-fbf168f835b2', 'volume_size': 1}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6652f1-18ff-4741-9532-fbf168f835b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdaa8dda9fb4d0cb91fbe0a4b7ddbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:55:44Z,use_quota=True,user_id='e4968fc628a6457982dc2b333dfad378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Creating volume fc6652f1-18ff-4741-9532-fbf168f835b2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:55:44 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:55:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:44 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 1073741824
Jul 02 04:55:44 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:45 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 1073741824" returned: 0 in 1.106s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:45 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2
Jul 02 04:55:45 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:46 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2" returned: 0 in 0.866s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1013944b-0017-4be4-89f9-37d4d7010235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6652f1-18ff-4741-9532-fbf168f835b2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5074296d-deba-4eab-b4f6-ea913a94bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:55:46 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Volume volume-fc6652f1-18ff-4741-9532-fbf168f835b2 (fc6652f1-18ff-4741-9532-fbf168f835b2): created successfully
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5074296d-deba-4eab-b4f6-ea913a94bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:55:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Flow 'volume_create_manager' (1073d5e3-29fa-4fdc-8f4e-1d7ca5e8b272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:55:46 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4ad01cdf-712a-4957-bb3a-f42ce8f05b29 tempest-VolumesListAdminTestJSON-1208306430 None] Created volume successfully.
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Acquiring lock "cinder-fc6652f1-18ff-4741-9532-fbf168f835b2-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "cinder-fc6652f1-18ff-4741-9532-fbf168f835b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=105,cinder:SELECT=69,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=81,cinder:DELETE=14 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Acquiring lock "cinder-quobyte-fc6652f1-18ff-4741-9532-fbf168f835b2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "cinder-quobyte-fc6652f1-18ff-4741-9532-fbf168f835b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffc5218-ac5c-4ba6-8bf0-c1a80e6f4cb2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-1717c7d9-5682-41c2-8d96-9283f5944b4e-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-1717c7d9-5682-41c2-8d96-9283f5944b4e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-quobyte-1717c7d9-5682-41c2-8d96-9283f5944b4e" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-1717c7d9-5682-41c2-8d96-9283f5944b4e" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:48 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2
Jul 02 04:55:48 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f1e23-edc2-4f25-aee7-1f3dbb4195ba]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:48 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e
Jul 02 04:55:48 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:49 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2" returned: 0 in 1.034s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:49 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2
Jul 02 04:55:49 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:49 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e" returned: 0 in 1.092s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:49 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e
Jul 02 04:55:49 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:50 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-fc6652f1-18ff-4741-9532-fbf168f835b2" returned: 0 in 0.783s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "cinder-quobyte-fc6652f1-18ff-4741-9532-fbf168f835b2" released by "delete_volume" :: held 1.873s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Created reservations ['b63d033e-2c98-4d9c-ae75-0a655ebf6362', 'd0c0389b-2df3-47f4-b702-4e078628d70a', 'bb753e1e-3906-4a78-a0b7-89c134d6c26c', 'a2cba5e5-317a-463e-a639-fa765eaebbc2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:50 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:50 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:50 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-1717c7d9-5682-41c2-8d96-9283f5944b4e" returned: 0 in 0.789s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-1717c7d9-5682-41c2-8d96-9283f5944b4e" released by "delete_volume" :: held 1.943s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Created reservations ['59fcab94-fbbe-4a62-aee3-824529ea946d', 'cdd9150d-5e86-4358-9877-8ab3b5d8f7db', 'a3af4405-6b34-43b4-8ccd-f4da84b1bbce', '08ac7b29-aa95-4723-b6de-77a7fea807e0'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:50 devstack sudo[98301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:50 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-quobyte-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" acquired by "delete_volume" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf1143-a29f-4946-b988-6922c6f26ba9]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:51 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105
Jul 02 04:55:51 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:51 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.158s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Deleted volume successfully.
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-71cceb60-8a91-4792-8f78-0f2b424c6c64 tempest-VolumesListAdminTestJSON-1208306430 None] Lock "cinder-fc6652f1-18ff-4741-9532-fbf168f835b2-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:51 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.180s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:51 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:51 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Deleted volume successfully.
Jul 02 04:55:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7eabe2b1-1763-4a41-9fbf-5e5a20ccb27a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-1717c7d9-5682-41c2-8d96-9283f5944b4e-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:52 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" returned: 0 in 1.296s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb97212-4abf-4250-b097-3bc0ab10ce63]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:52 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105
Jul 02 04:55:52 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:52 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8
Jul 02 04:55:52 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:52 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.078s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:55:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:55:53 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" returned: 0 in 0.796s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105" released by "delete_volume" :: held 2.176s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Created reservations ['52398cd2-705e-4edc-9fbf-b411a229fa40', '5b40fafb-8741-44ac-9cfc-413fcd9bc3c5', '3e6cce32-1361-4456-8069-592266288e26', '972aae44-6a2a-40e7-8ec8-ea79a0233abf'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:53 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:53 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:53 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8" returned: 0 in 0.986s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff6891b1-8f4a-47ab-9473-44b83722aaea', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:55:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-be06a137-e741-439c-af18-77e619c960ce req-65f69c07-e7e2-448c-aa3e-b9ef658536e0 tempest-TestServerVolumeAttachmentScenario-1087467154 None] attachment_update completed successfully.
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.692s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:53 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Deleted volume successfully.
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-430f052c-802d-4579-a2dc-10192d9945af tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-60bdc60d-95a3-4f90-9ff1-ef0ad7f8f105-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-8c743012-bea5-43ec-9c4a-f8d5dcbea529-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-8c743012-bea5-43ec-9c4a-f8d5dcbea529-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "cinder-quobyte-8c743012-bea5-43ec-9c4a-f8d5dcbea529" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-8c743012-bea5-43ec-9c4a-f8d5dcbea529" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[39376d86-1c1a-4f93-a653-efff7184a254]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:55:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:54 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529
Jul 02 04:55:54 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:55 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529" returned: 0 in 0.914s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:55 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529
Jul 02 04:55:55 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:56 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8c743012-bea5-43ec-9c4a-f8d5dcbea529" returned: 0 in 0.655s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-quobyte-8c743012-bea5-43ec-9c4a-f8d5dcbea529" released by "delete_volume" :: held 1.612s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Created reservations ['35d251a3-f537-49ce-8740-23bfd646d07a', '9e7cb42f-f87c-41d7-8caa-729d8a619a87', 'fd206fcf-49f1-42e6-8565-c787b3b4eb73', '0e63b0d9-8edc-4834-a37f-111633afa1b8'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:55:56 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:55:56 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:55:56 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.660s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:55:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Deleted volume successfully.
Jul 02 04:55:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-210e48ae-1351-4397-8365-2ff3a2cfd20a tempest-VolumesListAdminTestJSON-191541105 None] Lock "cinder-8c743012-bea5-43ec-9c4a-f8d5dcbea529-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:55:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-05ab90a6-883e-4783-8ae6-4efb7d62fd43 req-0dd0eaf0-e73d-449b-bc94-a49a84df9d9a tempest-TestServerVolumeAttachmentScenario-1087467154 None] Terminate volume connection completed successfully.
Jul 02 04:55:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-05ab90a6-883e-4783-8ae6-4efb7d62fd43 req-0dd0eaf0-e73d-449b-bc94-a49a84df9d9a tempest-TestServerVolumeAttachmentScenario-1087467154 None] Deleting attachment ff6891b1-8f4a-47ab-9473-44b83722aaea. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:56:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-d4fa3f1a-fdc7-48be-9a92-5f4c0fc0ef89 req-4968c8cb-3311-4322-a6cc-349d376c5fd9 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Terminate volume connection completed successfully.
Jul 02 04:56:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-d4fa3f1a-fdc7-48be-9a92-5f4c0fc0ef89 req-4968c8cb-3311-4322-a6cc-349d376c5fd9 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Deleting attachment 3378ecd9-2f67-47f2-8dc9-fd24f5497a11. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Flow 'volume_create_manager' (a36f72f3-2656-4f90-945f-a84a38635048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fb374-7f8a-4a70-8993-0a760be378b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554fb374-7f8a-4a70-8993-0a760be378b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881147516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96393ff-2461-42ea-a6da-3b7c3f4cb347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a5a40df84149efa08576a623a92a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:05Z,use_quota=True,user_id='71e325fbe66e4813913a75ab16c113f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629d8144-426b-4b6e-a5dd-572cdfeea7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629d8144-426b-4b6e-a5dd-572cdfeea7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e2c3fd-f905-41ce-8b41-a3016211b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e2c3fd-f905-41ce-8b41-a3016211b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96393ff-2461-42ea-a6da-3b7c3f4cb347', 'volume_name': 'volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde44b42-e29e-45a8-9d6b-86155582644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde44b42-e29e-45a8-9d6b-86155582644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8ef653-6b89-4c20-8809-e13d59170e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Volume b96393ff-2461-42ea-a6da-3b7c3f4cb347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347', 'volume_size': 1}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881147516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96393ff-2461-42ea-a6da-3b7c3f4cb347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a5a40df84149efa08576a623a92a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:05Z,use_quota=True,user_id='71e325fbe66e4813913a75ab16c113f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Creating volume b96393ff-2461-42ea-a6da-3b7c3f4cb347 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:05 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:05 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 1073741824
Jul 02 04:56:05 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:06 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 1073741824" returned: 0 in 0.936s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:06 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347
Jul 02 04:56:06 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:07 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347" returned: 0 in 0.800s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8ef653-6b89-4c20-8809-e13d59170e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b78e0b3-9bbb-4e1f-bb24-c3e640666555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:07 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Volume volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 (b96393ff-2461-42ea-a6da-3b7c3f4cb347): created successfully
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b78e0b3-9bbb-4e1f-bb24-c3e640666555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Flow 'volume_create_manager' (a36f72f3-2656-4f90-945f-a84a38635048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-69136ae9-b111-4c94-b579-c67db33378bf tempest-VolumesTransfersV355Test-84029933 None] Created volume successfully.
Jul 02 04:56:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bc5aa9a9-4007-400a-8283-c6e5900c052d tempest-VolumesTransfersV355Test-1830709662 None] Transfer volume completed successfully.
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "cinder-b96393ff-2461-42ea-a6da-3b7c3f4cb347-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-b96393ff-2461-42ea-a6da-3b7c3f4cb347-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "cinder-quobyte-b96393ff-2461-42ea-a6da-3b7c3f4cb347" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-quobyte-b96393ff-2461-42ea-a6da-3b7c3f4cb347" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c0efc8-de1a-4ea6-9234-74794461fa86]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:09 devstack sudo[98510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347
Jul 02 04:56:09 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:10 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347" returned: 0 in 0.777s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:10 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347
Jul 02 04:56:10 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:11 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b96393ff-2461-42ea-a6da-3b7c3f4cb347" returned: 0 in 0.665s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-quobyte-b96393ff-2461-42ea-a6da-3b7c3f4cb347" released by "delete_volume" :: held 1.482s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Created reservations ['4033ac88-94ae-4518-be84-0cc307546f1e', '4b4c362b-b4f9-48ec-b60b-1aecc14950db', 'a236cb40-b02d-4687-86b5-8e15533e6cb0', '1044c8de-41a5-4f82-85da-09f8210af2d6'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:11 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:11 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:11 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.690s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Deleted volume successfully.
Jul 02 04:56:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-50f21958-c1aa-4d05-b62b-d93e7f2aba07 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-b96393ff-2461-42ea-a6da-3b7c3f4cb347-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Flow 'volume_create_manager' (0459f16c-5a31-4537-94cc-cf724d262424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c08e3c-92c0-417a-807b-1f85bf126f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c08e3c-92c0-417a-807b-1f85bf126f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824160111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f06764-258c-48c1-aeef-80620f31e5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a5a40df84149efa08576a623a92a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:12Z,use_quota=True,user_id='71e325fbe66e4813913a75ab16c113f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e27146-7eb8-46d5-b5f4-adede43b0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e27146-7eb8-46d5-b5f4-adede43b0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7fe78d-5ea9-4efc-9cf5-dd504b365870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7fe78d-5ea9-4efc-9cf5-dd504b365870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f06764-258c-48c1-aeef-80620f31e5ba', 'volume_name': 'volume-99f06764-258c-48c1-aeef-80620f31e5ba', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb85330-5dad-4a79-957a-2460edfeb49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb85330-5dad-4a79-957a-2460edfeb49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3db4def-acd0-4323-90c2-7081de10e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:12 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Volume 99f06764-258c-48c1-aeef-80620f31e5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f06764-258c-48c1-aeef-80620f31e5ba', 'volume_size': 1}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824160111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f06764-258c-48c1-aeef-80620f31e5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a5a40df84149efa08576a623a92a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:12Z,use_quota=True,user_id='71e325fbe66e4813913a75ab16c113f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Creating volume 99f06764-258c-48c1-aeef-80620f31e5ba {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:12 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:12 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba 1073741824
Jul 02 04:56:12 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:13 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba 1073741824" returned: 0 in 0.800s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:13 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba
Jul 02 04:56:13 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:13 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba" returned: 0 in 0.616s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3db4def-acd0-4323-90c2-7081de10e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f06764-258c-48c1-aeef-80620f31e5ba', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbb9647-88f8-4630-bc15-cfb7d697fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:13 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Volume volume-99f06764-258c-48c1-aeef-80620f31e5ba (99f06764-258c-48c1-aeef-80620f31e5ba): created successfully
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbb9647-88f8-4630-bc15-cfb7d697fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Flow 'volume_create_manager' (0459f16c-5a31-4537-94cc-cf724d262424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a64f0e98-6c4a-4b62-81b5-99055da40cfe tempest-VolumesTransfersV355Test-84029933 None] Created volume successfully.
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "cinder-29bf75e1-fbed-4c6c-9f54-03104c2aace8-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-29bf75e1-fbed-4c6c-9f54-03104c2aace8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "cinder-quobyte-29bf75e1-fbed-4c6c-9f54-03104c2aace8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-quobyte-29bf75e1-fbed-4c6c-9f54-03104c2aace8" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2027444-8838-4f2d-857e-9f58a6fc3def]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "cinder-99f06764-258c-48c1-aeef-80620f31e5ba-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-99f06764-258c-48c1-aeef-80620f31e5ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "cinder-quobyte-99f06764-258c-48c1-aeef-80620f31e5ba" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-quobyte-99f06764-258c-48c1-aeef-80620f31e5ba" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:14 devstack sudo[98537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8
Jul 02 04:56:14 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28447c7-89eb-4e7d-85b2-98a9e6882ade]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:14 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba
Jul 02 04:56:14 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:15 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8" returned: 0 in 0.775s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:15 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8
Jul 02 04:56:15 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:15 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba" returned: 0 in 0.768s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:15 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba
Jul 02 04:56:15 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:16 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-29bf75e1-fbed-4c6c-9f54-03104c2aace8" returned: 0 in 0.670s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-quobyte-29bf75e1-fbed-4c6c-9f54-03104c2aace8" released by "delete_volume" :: held 1.488s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Created reservations ['b4fa370d-bbc7-47f0-b6d1-b793ffe8b061', '8e37f992-b7a8-4d4e-acec-f5470d8c05e8', '0855fc16-0b50-4171-ae8d-13d6a9c5dd01', '2faf91cb-1c63-4814-86de-dd334bcc2b47'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:16 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-99f06764-258c-48c1-aeef-80620f31e5ba" returned: 0 in 0.675s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:16 devstack sudo[98553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:16 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-quobyte-99f06764-258c-48c1-aeef-80620f31e5ba" released by "delete_volume" :: held 1.493s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Created reservations ['1e31a3b8-7783-4f67-91ad-59e4a30de95e', 'e119a740-8464-4ea9-aedc-de597d27b3fd', '84a4b4e5-eaae-4097-8ca0-ea1add31e917', '03c0c2fa-be57-4566-af01-f27478b24ee2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:16 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:16 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "cinder-4cfeb1d2-9418-4605-963c-e5c5a816cd6f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-4cfeb1d2-9418-4605-963c-e5c5a816cd6f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:16 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.646s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Deleted volume successfully.
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "cinder-quobyte-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-90f3974e-13d8-409e-a14a-6c7e5a55c61f tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-29bf75e1-fbed-4c6c-9f54-03104c2aace8-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-quobyte-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac22aa5-213c-41c1-b62a-3245428b1923]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:17 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.694s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:17 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Deleted volume successfully.
Jul 02 04:56:17 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f
Jul 02 04:56:17 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99cdc6de-b0d8-4027-9224-c90546058b67 tempest-VolumesTransfersV355Test-1964028 None] Lock "cinder-99f06764-258c-48c1-aeef-80620f31e5ba-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:17 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" returned: 0 in 0.753s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:17 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f
Jul 02 04:56:17 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:18 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" returned: 0 in 0.683s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-quobyte-4cfeb1d2-9418-4605-963c-e5c5a816cd6f" released by "delete_volume" :: held 1.487s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Created reservations ['dde0de18-adfe-4a8f-a4b3-0f023f1f752e', '75f153a2-9846-45f4-9eb0-e9222ff738d4', '4597ba02-499d-445e-9bf8-9f4c72be0d8b', '972dba6d-634d-4f4e-a1a4-a6284e598191'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:18 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:18 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:19 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.869s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:19 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Deleted volume successfully.
Jul 02 04:56:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b14308f6-beea-409a-9908-5afebd6b4b59 tempest-TestServerVolumeAttachmentScenario-1087467154 None] Lock "cinder-4cfeb1d2-9418-4605-963c-e5c5a816cd6f-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Flow 'volume_create_manager' (386297c9-020d-4a76-a52b-58ff042e2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac024f4-7f5a-48cb-b6f9-fb4759eecd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-a3ef4f02-0b42-4c86-8f54-ce3b3a9ead5a req-7666acc2-b7f1-4ecf-acab-d9d77fbf88af tempest-AttachVolumeTestJSON-856083775 None] Terminate volume connection completed successfully.
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-a3ef4f02-0b42-4c86-8f54-ce3b3a9ead5a req-7666acc2-b7f1-4ecf-acab-d9d77fbf88af tempest-AttachVolumeTestJSON-856083775 None] Deleting attachment 3febd3d5-6bbf-44d4-b93f-a3d2777dd029. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac024f4-7f5a-48cb-b6f9-fb4759eecd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335889741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276706b-fc3a-4036-9cfa-c22edc2f6145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba6b0ebddb246f0b9124d64099387eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:25Z,use_quota=True,user_id='ad08b4dca36641128728d12936d3f9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202785c9-f738-4eee-9d3b-046ef2755f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202785c9-f738-4eee-9d3b-046ef2755f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102a270d-5484-496b-83bc-d1aa564cad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102a270d-5484-496b-83bc-d1aa564cad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9276706b-fc3a-4036-9cfa-c22edc2f6145', 'volume_name': 'volume-9276706b-fc3a-4036-9cfa-c22edc2f6145', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ef7e0d-a951-43b7-8167-25f5d5711556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ef7e0d-a951-43b7-8167-25f5d5711556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd17614-4d85-4974-b0f7-aee3e2e79c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Volume 9276706b-fc3a-4036-9cfa-c22edc2f6145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9276706b-fc3a-4036-9cfa-c22edc2f6145', 'volume_size': 1}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335889741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9276706b-fc3a-4036-9cfa-c22edc2f6145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba6b0ebddb246f0b9124d64099387eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:25Z,use_quota=True,user_id='ad08b4dca36641128728d12936d3f9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Creating volume 9276706b-fc3a-4036-9cfa-c22edc2f6145 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:24 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:24 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 1073741824
Jul 02 04:56:24 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:25 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 1073741824" returned: 0 in 0.988s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:25 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145
Jul 02 04:56:25 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:26 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145" returned: 0 in 0.741s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd17614-4d85-4974-b0f7-aee3e2e79c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9276706b-fc3a-4036-9cfa-c22edc2f6145', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c370db-1a07-4c24-9962-4aa17426899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Volume volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 (9276706b-fc3a-4036-9cfa-c22edc2f6145): created successfully
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c370db-1a07-4c24-9962-4aa17426899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Flow 'volume_create_manager' (386297c9-020d-4a76-a52b-58ff042e2058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:26 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0cf89f05-b0fa-4268-9fd2-6c089f1394b5 tempest-VolumesTransfersV357Test-734245269 None] Created volume successfully.
Jul 02 04:56:27 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0ee48528-48f8-4da4-9ba3-21a7f1845bb4 tempest-VolumesTransfersV357Test-296655532 None] Transfer volume completed successfully.
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "cinder-9276706b-fc3a-4036-9cfa-c22edc2f6145-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-9276706b-fc3a-4036-9cfa-c22edc2f6145-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "cinder-quobyte-9276706b-fc3a-4036-9cfa-c22edc2f6145" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-quobyte-9276706b-fc3a-4036-9cfa-c22edc2f6145" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74c8d9-be31-401f-8b5b-9d9ed97829e9]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:29 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145
Jul 02 04:56:29 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:29 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145" returned: 0 in 0.827s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:29 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145
Jul 02 04:56:29 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:30 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9276706b-fc3a-4036-9cfa-c22edc2f6145" returned: 0 in 0.681s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-quobyte-9276706b-fc3a-4036-9cfa-c22edc2f6145" released by "delete_volume" :: held 1.560s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Created reservations ['4294f7fc-5d94-4c45-9920-cc18b12ad511', '24fdded1-9d15-4361-89f7-6b2485e94a76', '35d9c9f5-9235-4fd2-bbd1-994bc92d83ca', '682d58cd-4302-489d-97a8-cf188f45752f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:30 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:30 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (4546780b-fa41-4322-a220-88d1b2ace17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5a7463-59d2-407f-825e-b705d1dd7066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5a7463-59d2-407f-825e-b705d1dd7066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708364734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec4724e-eef2-496b-8e72-5cd82f039876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:31Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707131a9-7a58-41e9-b445-d441ce3ddfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707131a9-7a58-41e9-b445-d441ce3ddfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce00218-ff12-4d32-b7a6-621687835a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce00218-ff12-4d32-b7a6-621687835a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec4724e-eef2-496b-8e72-5cd82f039876', 'volume_name': 'volume-0ec4724e-eef2-496b-8e72-5cd82f039876', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1277a53-7d44-461c-94f1-b2e018926744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1277a53-7d44-461c-94f1-b2e018926744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19f45a-c775-4e92-bddd-62869fcc9356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume 0ec4724e-eef2-496b-8e72-5cd82f039876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec4724e-eef2-496b-8e72-5cd82f039876', 'volume_size': 1}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708364734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec4724e-eef2-496b-8e72-5cd82f039876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:31Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume 0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:30 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:31 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 1073741824
Jul 02 04:56:31 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:31 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.742s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Deleted volume successfully.
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-81be2669-b0a8-409a-8042-5e8f2375850c tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-9276706b-fc3a-4036-9cfa-c22edc2f6145-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Flow 'volume_create_manager' (6d1e3d7f-2707-411c-90b7-a9737fec7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35edee0c-769e-471b-8ae1-fc4b33b4b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35edee0c-769e-471b-8ae1-fc4b33b4b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1186380859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba6b0ebddb246f0b9124d64099387eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:32Z,use_quota=True,user_id='ad08b4dca36641128728d12936d3f9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d62804-5af2-46e9-9cb5-5c57fee9771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d62804-5af2-46e9-9cb5-5c57fee9771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9107e21-eba3-4e2b-b169-7dff1f7fb77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9107e21-eba3-4e2b-b169-7dff1f7fb77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb', 'volume_name': 'volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a9e23-c9a5-4fae-99b4-3f4ea25da753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a9e23-c9a5-4fae-99b4-3f4ea25da753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18677824-cd4a-4e2c-a9c5-09535dcc4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Volume 26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb', 'volume_size': 1}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:31 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 1073741824" returned: 0 in 0.920s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:31 devstack sudo[98648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876
Jul 02 04:56:31 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:32 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876" returned: 0 in 0.646s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1186380859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ba6b0ebddb246f0b9124d64099387eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:32Z,use_quota=True,user_id='ad08b4dca36641128728d12936d3f9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Creating volume 26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:32 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:32 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb 1073741824
Jul 02 04:56:32 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19f45a-c775-4e92-bddd-62869fcc9356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec4724e-eef2-496b-8e72-5cd82f039876', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269c2325-1f05-4755-9295-ba9b9bdc9ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-0ec4724e-eef2-496b-8e72-5cd82f039876 (0ec4724e-eef2-496b-8e72-5cd82f039876): created successfully
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269c2325-1f05-4755-9295-ba9b9bdc9ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (4546780b-fa41-4322-a220-88d1b2ace17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8d50bb3e-65e8-4145-bd36-2744cf4e6802 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:33 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb 1073741824" returned: 0 in 0.832s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:33 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb
Jul 02 04:56:33 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:34 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" returned: 0 in 0.656s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating offline snapshot 53623c35-8604-443c-8ef3-4bb86c2d64ca of volume 0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18677824-cd4a-4e2c-a9c5-09535dcc4021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee731e1-abab-4820-81c0-5e91b4638fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25164d6-ef01-47ce-a961-f3fe94de720f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Volume volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb (26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb): created successfully
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee731e1-abab-4820-81c0-5e91b4638fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Flow 'volume_create_manager' (6d1e3d7f-2707-411c-90b7-a9737fec7242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3eba8b67-1163-4207-9494-6514701dacfd tempest-VolumesTransfersV357Test-734245269 None] Created volume successfully.
Jul 02 04:56:34 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876
Jul 02 04:56:34 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:34 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876" returned: 0 in 0.775s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:34 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca 1G
Jul 02 04:56:34 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "cinder-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "cinder-quobyte-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-quobyte-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ad0bc-3ff0-45d4-bf1a-9443c6a7403a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:35 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb
Jul 02 04:56:35 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:35 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca 1G" returned: 0 in 0.839s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec4724e-eef2-496b-8e72-5cd82f039876 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:35 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec4724e-eef2-496b-8e72-5cd82f039876 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca
Jul 02 04:56:35 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:35 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" returned: 0 in 0.777s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:36 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb
Jul 02 04:56:36 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:36 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec4724e-eef2-496b-8e72-5cd82f039876 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:36 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca is being set with open permissions: ugo+rw
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:36 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca
Jul 02 04:56:36 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:36 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" returned: 0 in 0.756s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-quobyte-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb" released by "delete_volume" :: held 1.604s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Created reservations ['377ae002-8969-4ebc-9bb5-a9ebfa1eff99', '57b0c8d2-3491-4b87-a789-eb0cfaf632f8', 'c1bd3448-7a72-4f7c-841c-60eced0e83bb', 'e34ff578-45a5-4468-a5c9-44b32235ee81'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:37 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:37 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:37 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca" returned: 0 in 1.249s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:37 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info
Jul 02 04:56:37 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:38 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.222s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:38 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:38 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Deleted volume successfully.
Jul 02 04:56:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-423d79ef-8257-4ee0-9bc2-1f3a0ccce926 tempest-VolumesTransfersV357Test-128030976 None] Lock "cinder-26b1e7e8-f6ba-4f7b-af45-9b5b1b1deffb-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:38 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info" returned: 0 in 0.954s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:38 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info is being set with open permissions: ugo+rw
Jul 02 04:56:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:38 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info
Jul 02 04:56:38 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:39 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.info" returned: 0 in 0.743s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.414s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-34b6766a-57ac-457d-a753-13926425c11d tempest-CreateVolumesFromSnapshotTest-940964441 None] Create snapshot completed successfully
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (1e783cb0-108d-4864-b082-e58b6d2b2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3fd71-5e52-461a-8c02-488a23ee4c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3fd71-5e52-461a-8c02-488a23ee4c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122590834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c07a4-01a5-4ffb-a0c2-ec82e50b671b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:41Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe85c3f-021e-4194-bdb1-6d9b9c86d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe85c3f-021e-4194-bdb1-6d9b9c86d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12000341-1434-4fe6-bb9b-426fa081e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12000341-1434-4fe6-bb9b-426fa081e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77c07a4-01a5-4ffb-a0c2-ec82e50b671b', 'volume_name': 'volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acdaaac-f566-46f5-913b-27c038247558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acdaaac-f566-46f5-913b-27c038247558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0aa018-9779-4774-8751-229a20ef1080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume d77c07a4-01a5-4ffb-a0c2-ec82e50b671b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b', 'volume_size': 1}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122590834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c07a4-01a5-4ffb-a0c2-ec82e50b671b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:41Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume d77c07a4-01a5-4ffb-a0c2-ec82e50b671b {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:41 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:41 devstack sudo[98779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b 1073741824
Jul 02 04:56:41 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (de5d440d-dde3-4128-90de-b574e3e98f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbff68d-b47e-46e5-8282-4c3e3ba3d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbff68d-b47e-46e5-8282-4c3e3ba3d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740655779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2e6259-6125-46b2-bb7d-b15d678ed04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:42Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e5a6d3-a573-43a0-a885-154e2fb3108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e5a6d3-a573-43a0-a885-154e2fb3108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bcc9f-28dd-4ed6-9c64-92eea871322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9bcc9f-28dd-4ed6-9c64-92eea871322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2e6259-6125-46b2-bb7d-b15d678ed04b', 'volume_name': 'volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a59233-d49f-490c-96f0-073470176dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a59233-d49f-490c-96f0-073470176dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ac3f8-a089-4192-ac2c-97345e0d8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:41 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume 2d2e6259-6125-46b2-bb7d-b15d678ed04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b', 'volume_size': 1}
Jul 02 04:56:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (04b66c74-4baa-4901-9a0d-501c0a89e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfd89da-fd5f-4022-822a-c67a1bd90817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfd89da-fd5f-4022-822a-c67a1bd90817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389530183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f8f735-4c66-4457-9307-71b5c1720b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:42Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e32cf-fe52-4d8b-ae61-b9431a8e7eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3e32cf-fe52-4d8b-ae61-b9431a8e7eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e3296f-cf72-4015-9369-6932ef40f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e3296f-cf72-4015-9369-6932ef40f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f8f735-4c66-4457-9307-71b5c1720b7e', 'volume_name': 'volume-21f8f735-4c66-4457-9307-71b5c1720b7e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43b79d3-4ba3-4c6c-ab4a-6aa30c9f209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43b79d3-4ba3-4c6c-ab4a-6aa30c9f209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bab6c6-cd67-406d-b7a1-ea47f3548d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:42 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume 21f8f735-4c66-4457-9307-71b5c1720b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f8f735-4c66-4457-9307-71b5c1720b7e', 'volume_size': 1}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:42 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b 1073741824" returned: 0 in 1.530s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:42 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b
Jul 02 04:56:42 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (13779ecd-89f4-4f81-a3bc-08d71439be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a997b8-3c38-4f10-9b33-4c113b205fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a997b8-3c38-4f10-9b33-4c113b205fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1867420181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204e7c76-d9f6-498b-ab46-5dd5c05b0b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:43Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec0892-fa4b-4117-aef5-60961a390a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ec0892-fa4b-4117-aef5-60961a390a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920adaae-f115-4197-8c53-be88636638f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920adaae-f115-4197-8c53-be88636638f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204e7c76-d9f6-498b-ab46-5dd5c05b0b02', 'volume_name': 'volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257c3c2e-cf85-4004-a308-98aee0bbf482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257c3c2e-cf85-4004-a308-98aee0bbf482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3c9dc8-8fc9-4ca0-b4ef-3dfadcef2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume 204e7c76-d9f6-498b-ab46-5dd5c05b0b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02', 'volume_size': 1}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (c08cdc2c-4a47-4beb-840f-3c634cdfaaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f5a8c-4466-4ef2-9a14-126d35ae229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f5a8c-4466-4ef2-9a14-126d35ae229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116383982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a0908-4e26-4989-8565-ee321ad30dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:43Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd33d1ba-0437-4fba-9f8c-f348840e5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd33d1ba-0437-4fba-9f8c-f348840e5642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797a6531-855e-40d4-a1e3-10108cbafb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797a6531-855e-40d4-a1e3-10108cbafb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445a0908-4e26-4989-8565-ee321ad30dfc', 'volume_name': 'volume-445a0908-4e26-4989-8565-ee321ad30dfc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f1c74-c11c-409d-8d8d-992d232d5d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f1c74-c11c-409d-8d8d-992d232d5d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81014f7b-4686-4cff-b14a-1cccc4d0337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume 445a0908-4e26-4989-8565-ee321ad30dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445a0908-4e26-4989-8565-ee321ad30dfc', 'volume_size': 1}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:43 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" returned: 0 in 0.997s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (2594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.909s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740655779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2e6259-6125-46b2-bb7d-b15d678ed04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:42Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume 2d2e6259-6125-46b2-bb7d-b15d678ed04b {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:43 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:43 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b 1073741824
Jul 02 04:56:43 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0aa018-9779-4774-8751-229a20ef1080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee48fb5b-8b9d-415e-885e-5822a9911b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b (d77c07a4-01a5-4ffb-a0c2-ec82e50b671b): created successfully
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee48fb5b-8b9d-415e-885e-5822a9911b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (1e783cb0-108d-4864-b082-e58b6d2b2650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c8551985-a561-4ed2-b4b7-0278e83b0135 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:44 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b 1073741824" returned: 0 in 1.129s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:45 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b
Jul 02 04:56:45 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:46 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b" returned: 0 in 0.991s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.443s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389530183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f8f735-4c66-4457-9307-71b5c1720b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:42Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume 21f8f735-4c66-4457-9307-71b5c1720b7e {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:46 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ac3f8-a089-4192-ac2c-97345e0d8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:46 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e 1073741824
Jul 02 04:56:46 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccac4dbb-f7bb-4a2e-bfec-9781ae7e3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:46 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b (2d2e6259-6125-46b2-bb7d-b15d678ed04b): created successfully
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccac4dbb-f7bb-4a2e-bfec-9781ae7e3246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (de5d440d-dde3-4128-90de-b574e3e98f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:46 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d71f00d8-a409-4b74-9f3b-9f465adf6e01 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:47 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e 1073741824" returned: 0 in 0.991s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:47 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e
Jul 02 04:56:47 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:47 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e" returned: 0 in 0.760s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.596s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1867420181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204e7c76-d9f6-498b-ab46-5dd5c05b0b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:43Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume 204e7c76-d9f6-498b-ab46-5dd5c05b0b02 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:47 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:47 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 1073741824
Jul 02 04:56:47 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78bab6c6-cd67-406d-b7a1-ea47f3548d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f8f735-4c66-4457-9307-71b5c1720b7e', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90692f86-1d09-4d74-b14f-7e12a3d94bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:47 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-21f8f735-4c66-4457-9307-71b5c1720b7e (21f8f735-4c66-4457-9307-71b5c1720b7e): created successfully
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90692f86-1d09-4d74-b14f-7e12a3d94bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (04b66c74-4baa-4901-9a0d-501c0a89e40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:47 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d761f8bb-f375-4430-bb41-3892c6fb78b6 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:48 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 1073741824" returned: 0 in 0.908s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=84,cinder:INSERT=26,cinder:UPDATE=113,cinder:DELETE=10 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:56:48 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=104,cinder:SELECT=79,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:56:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:48 devstack sudo[98863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02
Jul 02 04:56:48 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:49 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" returned: 0 in 0.954s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.235s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116383982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a0908-4e26-4989-8565-ee321ad30dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc5bf72136447a68403aa77ead3b65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:56:43Z,use_quota=True,user_id='c8f9aef128904d0ab11428302fd6997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Creating volume 445a0908-4e26-4989-8565-ee321ad30dfc {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:56:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3c9dc8-8fc9-4ca0-b4ef-3dfadcef2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5012bcdd-058e-4b21-b042-f3eca8148bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:49 devstack sudo[98866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc 1073741824
Jul 02 04:56:49 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 (204e7c76-d9f6-498b-ab46-5dd5c05b0b02): created successfully
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5012bcdd-058e-4b21-b042-f3eca8148bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (13779ecd-89f4-4f81-a3bc-08d71439be25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-12ce62eb-ddb5-4197-b1b1-a89d9a29f827 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:50 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc 1073741824" returned: 0 in 1.052s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:50 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc
Jul 02 04:56:50 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:51 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81014f7b-4686-4cff-b14a-1cccc4d0337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445a0908-4e26-4989-8565-ee321ad30dfc', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9420315-4352-402f-956b-1275c43440ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:56:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Volume volume-445a0908-4e26-4989-8565-ee321ad30dfc (445a0908-4e26-4989-8565-ee321ad30dfc): created successfully
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9420315-4352-402f-956b-1275c43440ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Flow 'volume_create_manager' (c08cdc2c-4a47-4beb-840f-3c634cdfaaae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:56:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5998cb3d-9c6d-43fc-afa2-d76c8cb0587b tempest-CreateVolumesFromSnapshotTest-940964441 None] Created volume successfully.
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:51 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:51 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-445a0908-4e26-4989-8565-ee321ad30dfc-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-445a0908-4e26-4989-8565-ee321ad30dfc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-445a0908-4e26-4989-8565-ee321ad30dfc" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-445a0908-4e26-4989-8565-ee321ad30dfc" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:52 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.819s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b1b90-1206-4aef-aece-2dc8a73b3467]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:52 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc
Jul 02 04:56:52 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:53 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:53 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc
Jul 02 04:56:53 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:54 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-445a0908-4e26-4989-8565-ee321ad30dfc" returned: 0 in 0.721s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-445a0908-4e26-4989-8565-ee321ad30dfc" released by "delete_volume" :: held 1.596s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['12b8a730-0acb-4d7f-be60-451a5954fabc', '0305c580-cf3a-4c26-8ff9-18d1c345bb95', '0c1ddde0-2c7a-479f-9773-9edba95fee02', 'e2745aa4-4ba8-4bd5-aecc-d0b2b3f2afc6'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:54 devstack sudo[98897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:54 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-204e7c76-d9f6-498b-ab46-5dd5c05b0b02-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-204e7c76-d9f6-498b-ab46-5dd5c05b0b02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[08889f3b-b1af-47da-9a50-62461122cc24]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:55 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02
Jul 02 04:56:55 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:55 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.954s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:55 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:56:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ec86b013-b00e-48ba-b42e-c3fbfc5e1d41 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-445a0908-4e26-4989-8565-ee321ad30dfc-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:55 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" returned: 0 in 0.799s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:55 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02
Jul 02 04:56:55 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:56 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" returned: 0 in 0.692s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-204e7c76-d9f6-498b-ab46-5dd5c05b0b02" released by "delete_volume" :: held 1.549s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['879f492d-1c03-4640-bb2e-6b74e60c3c1e', '11c6694a-74d6-497e-8e05-e886e6c9cfac', '332c2fa1-f9a4-467f-a7e5-ff4afb31cb00', '439da45a-e7ad-4969-bc76-0668746bd781'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:56 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:56 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-21f8f735-4c66-4457-9307-71b5c1720b7e-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-21f8f735-4c66-4457-9307-71b5c1720b7e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-21f8f735-4c66-4457-9307-71b5c1720b7e" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-21f8f735-4c66-4457-9307-71b5c1720b7e" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[52605d7e-4e47-4ef0-bc40-23865dad4bb2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:57 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.716s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:56:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d038012e-bf5b-44af-b5b8-46eb32fdf223 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-204e7c76-d9f6-498b-ab46-5dd5c05b0b02-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:57 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e
Jul 02 04:56:57 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:58 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e" returned: 0 in 0.882s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:58 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e
Jul 02 04:56:58 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:58 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-21f8f735-4c66-4457-9307-71b5c1720b7e" returned: 0 in 0.774s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-21f8f735-4c66-4457-9307-71b5c1720b7e" released by "delete_volume" :: held 1.711s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['46983787-e355-4c48-9d4a-524a484167e1', 'd50f2087-61c1-4ec8-bd3a-131883dc1971', '84f17d1f-95bd-43d4-ab32-6e10a251aa4a', 'adc7f0cc-280b-4494-89f5-08df0d5f0f3a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:59 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:56:59 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-2d2e6259-6125-46b2-bb7d-b15d678ed04b-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-2d2e6259-6125-46b2-bb7d-b15d678ed04b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-2d2e6259-6125-46b2-bb7d-b15d678ed04b" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-2d2e6259-6125-46b2-bb7d-b15d678ed04b" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[814adb70-bc19-43b6-8428-bd7eddb69982]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:56:59 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b
Jul 02 04:56:59 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:56:59 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:56:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:56:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eb60d3e5-fabc-47f0-bd89-cd8f6b92954b tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-21f8f735-4c66-4457-9307-71b5c1720b7e-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:00 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b" returned: 0 in 0.879s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:00 devstack sudo[98928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b
Jul 02 04:57:00 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:01 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2d2e6259-6125-46b2-bb7d-b15d678ed04b" returned: 0 in 0.720s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-2d2e6259-6125-46b2-bb7d-b15d678ed04b" released by "delete_volume" :: held 1.649s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['df93ee94-9aa1-477b-9457-96b8e09832e4', '2084b872-9a87-4971-83c2-3da0db247b26', 'b1e9b0c0-4776-426f-be3e-5713dd623fd2', '05fed297-e30a-46e8-9e41-ca12c015af9c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:01 devstack sudo[98934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:57:01 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe6c446-a483-4d66-a670-bc176b6ae345]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:01 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b
Jul 02 04:57:01 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:02 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.719s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:02 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:57:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:57:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-95851d08-42b5-4a4f-ac75-0554ae19ce47 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-2d2e6259-6125-46b2-bb7d-b15d678ed04b-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:02 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" returned: 0 in 1.011s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:02 devstack sudo[98982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b
Jul 02 04:57:02 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:03 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" returned: 0 in 0.696s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b" released by "delete_volume" :: held 1.758s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['fd8d1b4b-b06f-4229-b648-0f6a5a0246f6', '04e30097-c940-4967-b34f-4c1bf27c6cd5', '3bf39930-4fad-46f2-ab23-de0f4b1d04f7', '69ada0f4-c3c7-471f-b45b-55b8caee7214'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:03 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:57:03 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-53623c35-8604-443c-8ef3-4bb86c2d64ca-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-53623c35-8604-443c-8ef3-4bb86c2d64ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-53623c35-8604-443c-8ef3-4bb86c2d64ca" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-53623c35-8604-443c-8ef3-4bb86c2d64ca" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleting offline snapshot 53623c35-8604-443c-8ef3-4bb86c2d64ca of volume 0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] snapshot_file for this snap is: volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704a550-64d1-4fff-bca1-c68fb99d2025]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:04 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca
Jul 02 04:57:04 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:04 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:57:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:57:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-428e2dff-3f5d-4174-815d-253eb5f72fb4 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-d77c07a4-01a5-4ffb-a0c2-ec82e50b671b-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:05 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca" returned: 0 in 0.909s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec4724e-eef2-496b-8e72-5cd82f039876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:57:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[35175df2-a5b2-4953-a450-3d435f6d9a0c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:05 devstack sudo[98999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876
Jul 02 04:57:05 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:06 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876" returned: 0 in 0.899s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:06 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca
Jul 02 04:57:06 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:06 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca" returned: 0 in 0.925s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:06 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca
Jul 02 04:57:06 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:07 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876.53623c35-8604-443c-8ef3-4bb86c2d64ca" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-53623c35-8604-443c-8ef3-4bb86c2d64ca" released by "_delete_snapshot" :: held 3.530s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" released by "delete_snapshot" :: held 3.560s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:07 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['12233b4a-8d33-497c-9346-b2a5e5c66d87', '6c8b7fa6-884e-4830-8654-79573d95215b', '54e8b801-a206-482c-b1dd-26bc6793c0e3', '2056ea06-f19e-49c4-8dbb-d326f7b29d56'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:57:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Delete snapshot completed successfully.
Jul 02 04:57:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e5864f07-fdfe-472a-9f72-72161ee3c2ca tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-53623c35-8604-443c-8ef3-4bb86c2d64ca-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-0ec4724e-eef2-496b-8e72-5cd82f039876-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-0ec4724e-eef2-496b-8e72-5cd82f039876-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2d662-1926-490b-95c5-651861770e18]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:08 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876
Jul 02 04:57:08 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:09 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:09 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876
Jul 02 04:57:09 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:10 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0ec4724e-eef2-496b-8e72-5cd82f039876" returned: 0 in 0.805s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-quobyte-0ec4724e-eef2-496b-8e72-5cd82f039876" released by "delete_volume" :: held 1.762s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Created reservations ['d036b91d-eb9e-4284-8a16-54f5a443acd5', 'c5c880b0-458e-4238-a8fb-c41b15e37de7', '7062d747-daa8-4583-b359-dabcd582f836', '6d534636-d6ec-4910-9b4a-3ece9de84010'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:10 devstack sudo[99021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:57:10 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:11 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.742s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:11 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:57:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Deleted volume successfully.
Jul 02 04:57:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3a67884c-430e-4fe8-b238-feb760c17209 tempest-CreateVolumesFromSnapshotTest-940964441 None] Lock "cinder-0ec4724e-eef2-496b-8e72-5cd82f039876-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Flow 'volume_create_manager' (38ae0f81-8e3c-459f-80a2-5c490595d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b54614c-a5de-423c-b28b-e04dc0f124c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b54614c-a5de-423c-b28b-e04dc0f124c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a44a68-e6d2-42af-ad48-f2dc5fa529a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373d408a2b4d40caa9b562252fe2130d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:16Z,use_quota=True,user_id='ec7fd4a621cf4cc8911c9015ee5c141c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b774fa35-8edb-488e-a6b3-948e9194e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b774fa35-8edb-488e-a6b3-948e9194e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d59d1f-ce51-41ba-a09f-2dffb0729940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d59d1f-ce51-41ba-a09f-2dffb0729940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57a44a68-e6d2-42af-ad48-f2dc5fa529a8', 'volume_name': 'volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8', 'volume_size': 1, 'image_id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa00d16b521128f9f159012db8f9d1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '373d408a2b4d40caa9b562252fe2130d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0773167cdb098348742c5be5a3d362e93dccc51c6612b3bc52ae9c9205f83a91585523ca02c276a128f260ac8e19d380133b58241f816aaf41dc0c94a3172ed', 'id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'created_at': datetime.datetime(2026, 7, 2, 2, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b99d288-79a8-421a-be50-fe3d8793495f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ed3830>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e3f825-797e-4dc0-bd6f-20b483391849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e3f825-797e-4dc0-bd6f-20b483391849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b061ff2-0951-4f16-a613-6bbe676fde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:16 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8', 'volume_size': 1, 'image_id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa00d16b521128f9f159012db8f9d1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '373d408a2b4d40caa9b562252fe2130d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0773167cdb098348742c5be5a3d362e93dccc51c6612b3bc52ae9c9205f83a91585523ca02c276a128f260ac8e19d380133b58241f816aaf41dc0c94a3172ed', 'id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'created_at': datetime.datetime(2026, 7, 2, 2, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b99d288-79a8-421a-be50-fe3d8793495f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ed3830>}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Trying to clone 57a44a68-e6d2-42af-ad48-f2dc5fa529a8 from image 6b99d288-79a8-421a-be50-fe3d8793495f at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 04:57:16 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ab4df-a2b3-45aa-a541-413cbb408bb8]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:16 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:16 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:17 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:17 devstack sudo[99036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:17 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:18 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 1 in 0.872s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:18 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Temporary image 6b99d288-79a8-421a-be50-fe3d8793495f is fetched for user ec7fd4a621cf4cc8911c9015ee5c141c. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 04:57:18 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746f78a-db9e-4ee8-ac18-45ce8cf09c07]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:18 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:18 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:19 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:19 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:19 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:20 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a44a68-e6d2-42af-ad48-f2dc5fa529a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373d408a2b4d40caa9b562252fe2130d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:16Z,use_quota=True,user_id='ec7fd4a621cf4cc8911c9015ee5c141c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Creating volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:57:20 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:57:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:20 devstack sudo[99084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1073741824
Jul 02 04:57:20 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:21 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1073741824" returned: 0 in 0.944s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:21 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:21 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:22 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 0 in 0.671s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Attempting download of 6b99d288-79a8-421a-be50-fe3d8793495f ((None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}])) to volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb6b590-45b8-46fe-81eb-180eb104b23c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:22 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc
Jul 02 04:57:22 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:22 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:22 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc
Jul 02 04:57:22 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc" returned: 1 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b99d288-79a8-421a-be50-fe3d8793495f_83zpjvhc' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:23 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd61018-9e98-400c-a200-82f920ed406b]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:23 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:23 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:24 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 0 in 1.271s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:25 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD
Jul 02 04:57:25 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:25 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD" returned: 1 in 0.876s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:25 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] 6b99d288-79a8-421a-be50-fe3d8793495f was raw, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 04:57:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:25 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:25 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:27 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 0 in 1.481s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:27 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b99d288-79a8-421a-be50-fe3d8793495f_j1nh7nghdevstack@QuobyteHD, size 0.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:57:27 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 04:57:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:27 devstack sudo[99269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1G
Jul 02 04:57:27 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:28 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 1G" returned: 0 in 1.020s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:28 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d358e-bdcb-4faa-a0ac-cc4855c6f80d]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:28 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:28 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:57:29 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Flow 'volume_create_manager' (78d9966e-e9e5-458e-87d2-c129eacd27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724528d8-2052-4cad-b71f-887966346ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 0 in 0.997s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724528d8-2052-4cad-b71f-887966346ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1347343721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d12194-6f52-4b0c-8093-e815ac9d345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0be409d6b514f0a82321c1a19504ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:29Z,use_quota=True,user_id='069b0169e9924741902d16ec20fc7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff4832-f934-4c65-a565-d2abe863b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff4832-f934-4c65-a565-d2abe863b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a20211d-5b11-4ec2-a7c2-18f7f122692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a20211d-5b11-4ec2-a7c2-18f7f122692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d12194-6f52-4b0c-8093-e815ac9d345b', 'volume_name': 'volume-b4d12194-6f52-4b0c-8093-e815ac9d345b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447b09a-1159-4fd0-ae82-6a7f99467b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447b09a-1159-4fd0-ae82-6a7f99467b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034fd04d-0ac4-4e99-a29c-1335be9a7814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Volume b4d12194-6f52-4b0c-8093-e815ac9d345b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d12194-6f52-4b0c-8093-e815ac9d345b', 'volume_size': 1}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1347343721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d12194-6f52-4b0c-8093-e815ac9d345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0be409d6b514f0a82321c1a19504ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:29Z,use_quota=True,user_id='069b0169e9924741902d16ec20fc7b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Creating volume b4d12194-6f52-4b0c-8093-e815ac9d345b {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:57:29 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:57:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:29 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b 1073741824
Jul 02 04:57:29 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:29 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:29 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:30 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 1 in 1.129s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Downloaded image 6b99d288-79a8-421a-be50-fe3d8793495f ((None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}])) to volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Temporary image 6b99d288-79a8-421a-be50-fe3d8793495f for user ec7fd4a621cf4cc8911c9015ee5c141c is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Marking volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Copying metadata from image 6b99d288-79a8-421a-be50-fe3d8793495f to 57a44a68-e6d2-42af-ad48-f2dc5fa529a8. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Creating volume glance metadata for volume 57a44a68-e6d2-42af-ad48-f2dc5fa529a8 backed by image 6b99d288-79a8-421a-be50-fe3d8793495f with: {'image_id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7aa00d16b521128f9f159012db8f9d1a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 04:57:30 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b 1073741824" returned: 0 in 1.114s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b061ff2-0951-4f16-a613-6bbe676fde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8', 'volume_size': 1, 'image_id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b99d288-79a8-421a-be50-fe3d8793495f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aa00d16b521128f9f159012db8f9d1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '373d408a2b4d40caa9b562252fe2130d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0773167cdb098348742c5be5a3d362e93dccc51c6612b3bc52ae9c9205f83a91585523ca02c276a128f260ac8e19d380133b58241f816aaf41dc0c94a3172ed', 'id': '6b99d288-79a8-421a-be50-fe3d8793495f', 'created_at': datetime.datetime(2026, 7, 2, 2, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 57, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b99d288-79a8-421a-be50-fe3d8793495f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1ed3830>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb86eae-3f6a-4d12-bfd0-68924f658d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Volume volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 (57a44a68-e6d2-42af-ad48-f2dc5fa529a8): created successfully
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb86eae-3f6a-4d12-bfd0-68924f658d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:30 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b
Jul 02 04:57:30 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Flow 'volume_create_manager' (38ae0f81-8e3c-459f-80a2-5c490595d96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:30 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-598496b1-e829-40b8-b7bd-30637000080b tempest-VolumeImageDependencyTests-56953779 None] Created volume successfully.
Jul 02 04:57:31 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034fd04d-0ac4-4e99-a29c-1335be9a7814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d12194-6f52-4b0c-8093-e815ac9d345b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9926a78-bb2e-4e53-af88-02e3fd55b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Volume volume-b4d12194-6f52-4b0c-8093-e815ac9d345b (b4d12194-6f52-4b0c-8093-e815ac9d345b): created successfully
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9926a78-bb2e-4e53-af88-02e3fd55b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Flow 'volume_create_manager' (78d9966e-e9e5-458e-87d2-c129eacd27ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-87ff1feb-defd-4363-88a3-60765c598442 tempest-TestMinimumBasicScenario-568225676 None] Created volume successfully.
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Acquiring lock "cinder-57a44a68-e6d2-42af-ad48-f2dc5fa529a8-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "cinder-57a44a68-e6d2-42af-ad48-f2dc5fa529a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Acquiring lock "cinder-quobyte-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "cinder-quobyte-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02996ba-3ddd-4a72-92f9-c73238fab36e]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:32 devstack sudo[99305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:32 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:33 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 0 in 1.454s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:33 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:33 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:34 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 1 in 1.008s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:57:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:34 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8
Jul 02 04:57:34 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:34 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" returned: 0 in 0.648s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "cinder-quobyte-57a44a68-e6d2-42af-ad48-f2dc5fa529a8" released by "delete_volume" :: held 3.212s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Created reservations ['7dce0c5e-7082-4ab1-856d-527f187fc760', 'f69d3ba5-f3be-4d73-9b1c-207f777e508e', '32ad3543-98a3-45c1-8153-8f27c57d0266', '5cd668c4-5c57-48f6-a09a-208068885be9'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:35 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:57:35 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:35 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.753s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:35 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:57:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Deleted volume successfully.
Jul 02 04:57:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-db6c5f83-e496-4050-bd52-081e3a2b3cb3 tempest-VolumeImageDependencyTests-56953779 None] Lock "cinder-57a44a68-e6d2-42af-ad48-f2dc5fa529a8-delete_volume" released by "delete_volume" :: held 4.383s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:57:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[89565b4b-e16d-4237-a40a-952a98215dac]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:36 devstack sudo[99333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b
Jul 02 04:57:36 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:37 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b" returned: 0 in 1.042s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-b4d12194-6f52-4b0c-8093-e815ac9d345b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a29baaaf-98bd-4808-b42b-fbe96b4f3cf3', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:57:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-743723b2-733b-4afd-9c24-8e1c8cc7e5d0 req-fe454f30-4267-4d63-8426-941d9823c55a tempest-TestMinimumBasicScenario-568225676 None] attachment_update completed successfully.
Jul 02 04:57:47 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=63,cinder:SELECT=59,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:57:47 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=55,cinder:INSERT=28,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:51 devstack sudo[99826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:57:51 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:52 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.643s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:57:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:57:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:57:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (acfb757b-9381-4b49-b0bc-a5bff63f187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cad43f-06c4-4668-a2b9-0832514e5e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cad43f-06c4-4668-a2b9-0832514e5e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098252291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d56d71-e847-45ff-815a-f3f71f56fa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:53Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22e7821-d39e-4d2b-82da-b00d2e58a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22e7821-d39e-4d2b-82da-b00d2e58a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e617f6d6-7084-4ec8-b100-f10d195855fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e617f6d6-7084-4ec8-b100-f10d195855fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d56d71-e847-45ff-815a-f3f71f56fa51', 'volume_name': 'volume-23d56d71-e847-45ff-815a-f3f71f56fa51', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe09861f-50ef-4964-8608-407c4cb235ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe09861f-50ef-4964-8608-407c4cb235ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f258b95-4b53-421c-b3ad-6233a00d5763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Volume 23d56d71-e847-45ff-815a-f3f71f56fa51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d56d71-e847-45ff-815a-f3f71f56fa51', 'volume_size': 1}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1098252291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d56d71-e847-45ff-815a-f3f71f56fa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:57:53Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Creating volume 23d56d71-e847-45ff-815a-f3f71f56fa51 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:57:53 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:53 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 1073741824
Jul 02 04:57:53 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:53 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 1073741824" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:53 devstack sudo[99837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51
Jul 02 04:57:53 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:54 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51" returned: 0 in 0.652s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f258b95-4b53-421c-b3ad-6233a00d5763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d56d71-e847-45ff-815a-f3f71f56fa51', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48c3b97-b353-47db-a91b-2ad37337103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:57:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Volume volume-23d56d71-e847-45ff-815a-f3f71f56fa51 (23d56d71-e847-45ff-815a-f3f71f56fa51): created successfully
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48c3b97-b353-47db-a91b-2ad37337103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:57:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (acfb757b-9381-4b49-b0bc-a5bff63f187c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:57:54 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9d515857-a0d1-4fb9-a8c7-af1f05fe9577 tempest-AttachVolumeTestJSON-856083775 None] Created volume successfully.
Jul 02 04:57:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:57:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:57:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[96123fe7-2baa-45de-b297-337af87de052]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:57:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:57:58 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51
Jul 02 04:57:58 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:57:59 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Jul 02 04:57:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:57:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.754s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:57:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-23d56d71-e847-45ff-815a-f3f71f56fa51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98092a48-6c9b-474f-9f38-00613279b40f', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:57:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-1092337e-55b8-4faa-9d95-7d4a9e78a2bc req-2cf21d84-eb4f-49b2-8c65-1978ea0c3408 tempest-AttachVolumeTestJSON-856083775 None] attachment_update completed successfully.
Jul 02 04:58:03 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (7ac5a569-5c7c-4831-83de-7f053c254024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692c303f-1d4f-4f54-8096-cccda838c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692c303f-1d4f-4f54-8096-cccda838c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-763304047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211807b-3c04-4bdb-a58d-40c6f98a64ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:58:04Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b6cf68-5fd0-4c55-9986-b2461e138eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b6cf68-5fd0-4c55-9986-b2461e138eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f053a1f-0698-40b4-862b-3245d0f51163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f053a1f-0698-40b4-862b-3245d0f51163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c211807b-3c04-4bdb-a58d-40c6f98a64ed', 'volume_name': 'volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df34b3-34b3-4e26-b5a0-402776a8df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71df34b3-34b3-4e26-b5a0-402776a8df74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e52af93-3902-4a9a-81c4-87f721cb944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:04 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Volume c211807b-3c04-4bdb-a58d-40c6f98a64ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed', 'volume_size': 1}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-763304047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211807b-3c04-4bdb-a58d-40c6f98a64ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab893159582948d8a80eca85babbeea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:58:04Z,use_quota=True,user_id='e2ac0e6f076945b29a38a9bb77f6fb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Creating volume c211807b-3c04-4bdb-a58d-40c6f98a64ed {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:58:04 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:58:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:04 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed 1073741824
Jul 02 04:58:04 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:05 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed 1073741824" returned: 0 in 0.983s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:05 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed
Jul 02 04:58:05 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:05 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed" returned: 0 in 0.674s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e52af93-3902-4a9a-81c4-87f721cb944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1bc5-d694-4b9a-a9d2-6d45aedb2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Volume volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed (c211807b-3c04-4bdb-a58d-40c6f98a64ed): created successfully
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1bc5-d694-4b9a-a9d2-6d45aedb2580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Flow 'volume_create_manager' (7ac5a569-5c7c-4831-83de-7f053c254024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:58:05 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e213f1a6-c903-49ca-8dcc-363406ac4a0f tempest-AttachVolumeTestJSON-856083775 None] Created volume successfully.
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbbea3b-77ea-465d-a22d-d06db0cbfa75]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:09 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed
Jul 02 04:58:09 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:09 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed" returned: 0 in 0.772s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c8648d5-ffa4-4b80-a86d-9aad2353c8a0', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:58:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-ff2326d6-a821-4b9a-a710-08ec08112e79 req-a2e7f73a-dd8a-40d6-a734-3671bd27d6e6 tempest-AttachVolumeTestJSON-856083775 None] attachment_update completed successfully.
Jul 02 04:58:16 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-9b47fdf1-5979-4b87-b35a-febbc977a35e req-04a5e703-0710-4604-9986-4ebfde50d908 tempest-AttachVolumeTestJSON-856083775 None] Terminate volume connection completed successfully.
Jul 02 04:58:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-9b47fdf1-5979-4b87-b35a-febbc977a35e req-04a5e703-0710-4604-9986-4ebfde50d908 tempest-AttachVolumeTestJSON-856083775 None] Deleting attachment 98092a48-6c9b-474f-9f38-00613279b40f. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:58:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-e75cd5dd-95b3-4ff4-8413-4e1a813d3c16 req-49e96e1f-6071-4663-8070-bd6ea4e29ae0 tempest-AttachVolumeTestJSON-856083775 None] Terminate volume connection completed successfully.
Jul 02 04:58:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-e75cd5dd-95b3-4ff4-8413-4e1a813d3c16 req-49e96e1f-6071-4663-8070-bd6ea4e29ae0 tempest-AttachVolumeTestJSON-856083775 None] Deleting attachment 8c8648d5-ffa4-4b80-a86d-9aad2353c8a0. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:58:26 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:58:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-39eddfe5-6894-44e4-9a50-52596cef2dfc req-b7261c73-304b-4ee5-bd2b-68fc089de4e2 tempest-TestMinimumBasicScenario-568225676 None] Terminate volume connection completed successfully.
Jul 02 04:58:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-39eddfe5-6894-44e4-9a50-52596cef2dfc req-b7261c73-304b-4ee5-bd2b-68fc089de4e2 tempest-TestMinimumBasicScenario-568225676 None] Deleting attachment a29baaaf-98bd-4808-b42b-fbe96b4f3cf3. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-c211807b-3c04-4bdb-a58d-40c6f98a64ed-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-c211807b-3c04-4bdb-a58d-40c6f98a64ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-quobyte-c211807b-3c04-4bdb-a58d-40c6f98a64ed" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-c211807b-3c04-4bdb-a58d-40c6f98a64ed" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879b9b0-7586-474b-b69a-e02fd2d58feb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:29 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed
Jul 02 04:58:29 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:29 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed" returned: 0 in 0.756s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:29 devstack sudo[100148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed
Jul 02 04:58:29 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "cinder-b4d12194-6f52-4b0c-8093-e815ac9d345b-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "cinder-b4d12194-6f52-4b0c-8093-e815ac9d345b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "cinder-quobyte-b4d12194-6f52-4b0c-8093-e815ac9d345b" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "cinder-quobyte-b4d12194-6f52-4b0c-8093-e815ac9d345b" acquired by "delete_volume" :: waited 0.013s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e3b1f6-95e9-4efb-a75a-1eca87664739]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:30 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-c211807b-3c04-4bdb-a58d-40c6f98a64ed" returned: 0 in 0.684s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-c211807b-3c04-4bdb-a58d-40c6f98a64ed" released by "delete_volume" :: held 1.488s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Created reservations ['4821e7ff-f766-4965-8b12-e1307a9b14e2', '1e9e0ca9-8d02-4647-a6e1-5e0d41fe948f', '905af130-8ca5-491a-b774-36fa4b7dda09', '84d867ba-220e-46fd-8874-0b79e964f1f3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:58:30 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b
Jul 02 04:58:30 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:30 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:30 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-23d56d71-e847-45ff-815a-f3f71f56fa51-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-23d56d71-e847-45ff-815a-f3f71f56fa51-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-quobyte-23d56d71-e847-45ff-815a-f3f71f56fa51" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:31 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.674s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-23d56d71-e847-45ff-815a-f3f71f56fa51" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:31 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Deleted volume successfully.
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b" returned: 0 in 0.829s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a0162-a5ff-4c03-ae5b-7e27388ffba2]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:31 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b
Jul 02 04:58:31 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-953cc7f7-d107-4bed-b87e-397a853cb229 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-c211807b-3c04-4bdb-a58d-40c6f98a64ed-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:31 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51
Jul 02 04:58:31 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:32 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b4d12194-6f52-4b0c-8093-e815ac9d345b" returned: 0 in 0.652s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "cinder-quobyte-b4d12194-6f52-4b0c-8093-e815ac9d345b" released by "delete_volume" :: held 1.518s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Created reservations ['307c35ec-46a0-4c1b-bfeb-c53d9b8cd389', '6675285d-fcd5-49b0-90cf-173c4811e363', '8aa93e22-5f14-42fd-bb70-525c654d5059', '67e455bd-6417-4d45-895e-f47cc516f68e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:32 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51" returned: 0 in 0.783s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:32 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:32 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:32 devstack sudo[100170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51
Jul 02 04:58:32 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:32 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.697s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Deleted volume successfully.
Jul 02 04:58:32 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-23d56d71-e847-45ff-815a-f3f71f56fa51" returned: 0 in 0.694s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-23d56d71-e847-45ff-815a-f3f71f56fa51" released by "delete_volume" :: held 1.529s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-795c7f8c-c846-4259-815c-3b15f4119a87 tempest-TestMinimumBasicScenario-568225676 None] Lock "cinder-b4d12194-6f52-4b0c-8093-e815ac9d345b-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:32 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Created reservations ['4e196382-4397-4814-a8d4-a48d12f72feb', 'dda19e37-6ef8-4668-92ac-647b40576aea', '6f9ca3cc-490e-41d4-9fdc-c50e7f494a12', '743c579e-219e-4a44-b6cb-49bbc1c91813'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:33 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:33 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-9612085d-d97c-43ae-97f4-822000a6900d-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-9612085d-d97c-43ae-97f4-822000a6900d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "cinder-quobyte-9612085d-d97c-43ae-97f4-822000a6900d" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-9612085d-d97c-43ae-97f4-822000a6900d" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:33 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.659s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Deleted volume successfully.
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc3ccc-6a9b-48af-a467-9c6bd57207b3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-47f0d563-4411-451e-bcdc-40b0535c2139 tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-23d56d71-e847-45ff-815a-f3f71f56fa51-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:33 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d
Jul 02 04:58:33 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:34 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d" returned: 0 in 0.933s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:34 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d
Jul 02 04:58:34 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:35 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-9612085d-d97c-43ae-97f4-822000a6900d" returned: 0 in 0.663s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-quobyte-9612085d-d97c-43ae-97f4-822000a6900d" released by "delete_volume" :: held 1.647s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Created reservations ['a79ca9f6-4e28-43e0-baa9-3eb5c0df9b97', '612c5892-db37-41c6-bd53-6f668168eb79', '7cd228df-5e78-46c8-990a-481a891830d3', 'd5cdc96b-9fe9-4a87-b6b6-12be42c815e6'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:35 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:35 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:36 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.711s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:36 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:36 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Deleted volume successfully.
Jul 02 04:58:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14b7869f-62ff-483f-84d1-3c17f824fb2c tempest-AttachVolumeTestJSON-856083775 None] Lock "cinder-9612085d-d97c-43ae-97f4-822000a6900d-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=42,cinder:SELECT=39,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:58:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=21,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Flow 'volume_create_manager' (f69eee9f-9c59-4256-b241-9aec026691a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f143df-51a8-45d9-b60c-610262e648d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f143df-51a8-45d9-b60c-610262e648d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1949137713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6114020b-bc08-468e-90c8-62be7a1438e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5dd3316ebf4adba42dd1cebdeae76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:58:52Z,use_quota=True,user_id='2ee76763d9e1401e986140e62b2fe195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e82ca3-8c5c-4f61-83bc-5c454ca4e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e82ca3-8c5c-4f61-83bc-5c454ca4e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab3b16c-1815-4c43-9acd-8df53545d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab3b16c-1815-4c43-9acd-8df53545d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6114020b-bc08-468e-90c8-62be7a1438e2', 'volume_name': 'volume-6114020b-bc08-468e-90c8-62be7a1438e2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fdfcdf-8d9b-4d2b-bd45-bcb553317cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fdfcdf-8d9b-4d2b-bd45-bcb553317cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f31e09c-c1d4-4891-85cc-4f9a6bafedfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Volume 6114020b-bc08-468e-90c8-62be7a1438e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6114020b-bc08-468e-90c8-62be7a1438e2', 'volume_size': 1}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1949137713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6114020b-bc08-468e-90c8-62be7a1438e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5dd3316ebf4adba42dd1cebdeae76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:58:52Z,use_quota=True,user_id='2ee76763d9e1401e986140e62b2fe195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Creating volume 6114020b-bc08-468e-90c8-62be7a1438e2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:58:51 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:51 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 1073741824
Jul 02 04:58:51 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:51 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:51 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.718s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:58:52 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 1073741824" returned: 0 in 0.922s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:52 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2
Jul 02 04:58:52 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:53 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2" returned: 0 in 0.659s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f31e09c-c1d4-4891-85cc-4f9a6bafedfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6114020b-bc08-468e-90c8-62be7a1438e2', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec942d0f-6de4-4a9f-ac0d-ee7c6c65f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:58:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Volume volume-6114020b-bc08-468e-90c8-62be7a1438e2 (6114020b-bc08-468e-90c8-62be7a1438e2): created successfully
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec942d0f-6de4-4a9f-ac0d-ee7c6c65f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Flow 'volume_create_manager' (f69eee9f-9c59-4256-b241-9aec026691a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:58:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-73edc818-50ee-4ae1-9ad7-01dcf3646881 tempest-VolumesServicesTestJSON-1048381048 None] Created volume successfully.
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Acquiring lock "cinder-6114020b-bc08-468e-90c8-62be7a1438e2-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "cinder-6114020b-bc08-468e-90c8-62be7a1438e2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Acquiring lock "cinder-quobyte-6114020b-bc08-468e-90c8-62be7a1438e2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:58:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "cinder-quobyte-6114020b-bc08-468e-90c8-62be7a1438e2" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:58:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f74eba-aa23-4095-baee-5d9b7e934dc3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:58:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:54 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2
Jul 02 04:58:54 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:54 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2" returned: 0 in 0.796s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:54 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2
Jul 02 04:58:54 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:55 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6114020b-bc08-468e-90c8-62be7a1438e2" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "cinder-quobyte-6114020b-bc08-468e-90c8-62be7a1438e2" released by "delete_volume" :: held 1.589s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Created reservations ['16b2cbcf-8a48-4c5a-91ac-811ed3d552d3', '978253f0-af7f-4d6f-a27f-53f03468b2e7', 'b6bf03e3-582e-4862-8532-ecafa043e3bb', 'f220fe25-193b-47ff-a930-666a9026185a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:58:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:58:55 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:58:55 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:58:56 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 02 04:58:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.744s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:58:56 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:58:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Deleted volume successfully.
Jul 02 04:58:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-93bcb2d5-2aae-4ce5-80a6-e5d431e2c775 tempest-VolumesServicesTestJSON-1048381048 None] Lock "cinder-6114020b-bc08-468e-90c8-62be7a1438e2-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:05 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Flow 'volume_create_manager' (62c3091f-2fc9-4822-98a7-de86236a945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9262894b-47ce-4893-8bb8-a938da184b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9262894b-47ce-4893-8bb8-a938da184b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-297028014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31fc661-5591-4d27-a74d-753d868e75a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74e30a8f7b546feb88c8a56d5397247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:07Z,use_quota=True,user_id='a5a217b30d914a0f82a5c61523898ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031e740-1ab0-49b2-b37e-d5c6d610ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031e740-1ab0-49b2-b37e-d5c6d610ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd05bf-d174-4938-83e3-51d953dafbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd05bf-d174-4938-83e3-51d953dafbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31fc661-5591-4d27-a74d-753d868e75a4', 'volume_name': 'volume-f31fc661-5591-4d27-a74d-753d868e75a4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49720a1-63af-4449-9320-7f31001d41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49720a1-63af-4449-9320-7f31001d41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eda7326-b261-4b2e-8814-704e603b206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:06 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Volume f31fc661-5591-4d27-a74d-753d868e75a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31fc661-5591-4d27-a74d-753d868e75a4', 'volume_size': 1}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-297028014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31fc661-5591-4d27-a74d-753d868e75a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74e30a8f7b546feb88c8a56d5397247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:07Z,use_quota=True,user_id='a5a217b30d914a0f82a5c61523898ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Creating volume f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:59:06 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:59:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:07 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 1073741824
Jul 02 04:59:07 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:07 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 1073741824" returned: 0 in 0.958s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:08 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4
Jul 02 04:59:08 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:08 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4" returned: 0 in 0.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eda7326-b261-4b2e-8814-704e603b206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31fc661-5591-4d27-a74d-753d868e75a4', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09eb296-2ac9-43fa-ad62-a00e0b6ad4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Volume volume-f31fc661-5591-4d27-a74d-753d868e75a4 (f31fc661-5591-4d27-a74d-753d868e75a4): created successfully
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09eb296-2ac9-43fa-ad62-a00e0b6ad4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Flow 'volume_create_manager' (62c3091f-2fc9-4822-98a7-de86236a945b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d7513ede-72ea-49a1-93ce-82a02c20df2d tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Created volume successfully.
Jul 02 04:59:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Creating offline snapshot 9378a8c7-a6bb-483e-b02d-babf3d3b76f6 of volume f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 04:59:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc0fd3-20a3-4105-9a70-8d3939f8101d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:09 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4
Jul 02 04:59:09 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:10 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:10 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 1G
Jul 02 04:59:10 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:10 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 1G" returned: 0 in 0.888s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fc661-5591-4d27-a74d-753d868e75a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:10 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fc661-5591-4d27-a74d-753d868e75a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6
Jul 02 04:59:10 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:11 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31fc661-5591-4d27-a74d-753d868e75a4 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6" returned: 0 in 0.724s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:11 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 is being set with open permissions: ugo+rw
Jul 02 04:59:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:11 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6
Jul 02 04:59:11 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:12 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:12 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info
Jul 02 04:59:12 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:13 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info" returned: 0 in 0.659s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:13 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info is being set with open permissions: ugo+rw
Jul 02 04:59:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:13 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info
Jul 02 04:59:13 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:13 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.info" returned: 0 in 0.701s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-68fb9cce-a5e9-401e-9949-d66ed6769886 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Create snapshot completed successfully
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "cinder-9378a8c7-a6bb-483e-b02d-babf3d3b76f6-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-9378a8c7-a6bb-483e-b02d-babf3d3b76f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "cinder-quobyte-9378a8c7-a6bb-483e-b02d-babf3d3b76f6" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-9378a8c7-a6bb-483e-b02d-babf3d3b76f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Deleting offline snapshot 9378a8c7-a6bb-483e-b02d-babf3d3b76f6 of volume f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] snapshot_file for this snap is: volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[15664eba-ab65-461a-a6de-f7ab298d7ebe]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:15 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6
Jul 02 04:59:15 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:15 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6" returned: 0 in 0.768s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:15 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31fc661-5591-4d27-a74d-753d868e75a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 04:59:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[04002aaf-4ba8-4129-9dce-e4f7a5fe09b6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:15 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4
Jul 02 04:59:15 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:16 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4" returned: 0 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:16 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6
Jul 02 04:59:16 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:17 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6" returned: 0 in 0.763s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:17 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6
Jul 02 04:59:17 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:17 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4.9378a8c7-a6bb-483e-b02d-babf3d3b76f6" returned: 0 in 0.697s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-9378a8c7-a6bb-483e-b02d-babf3d3b76f6" released by "_delete_snapshot" :: held 3.118s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" released by "delete_snapshot" :: held 3.145s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:18 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Created reservations ['cf0505c3-e946-42c2-89b0-c91e28ca4a9d', '10e5339f-3798-4597-b722-222d6a2d9ca0', '6c98e39e-084e-4484-bb67-6303404ed1d2', '02f74519-3f60-431b-b00c-ff4189fd6337'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:59:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Delete snapshot completed successfully.
Jul 02 04:59:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5652e6e2-f38b-4cdc-9551-06d4bd9ed799 tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-9378a8c7-a6bb-483e-b02d-babf3d3b76f6-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "cinder-f31fc661-5591-4d27-a74d-753d868e75a4-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-f31fc661-5591-4d27-a74d-753d868e75a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7557fd-3db6-42b7-9c7d-7487e2b4909e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:19 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4
Jul 02 04:59:19 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:20 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4" returned: 0 in 0.806s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:20 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4
Jul 02 04:59:20 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:20 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f31fc661-5591-4d27-a74d-753d868e75a4" returned: 0 in 0.704s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-quobyte-f31fc661-5591-4d27-a74d-753d868e75a4" released by "delete_volume" :: held 1.565s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Created reservations ['d04fcbda-2c68-4791-873d-05a407510f2f', '8e6255a4-7b2b-49ea-8c29-68b3bdf0db87', '9c306f7a-1aa7-4bad-8173-0fb4bd405869', '743ea70f-f054-411e-8fe8-81708624eb48'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:20 devstack sudo[100392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:59:20 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:21 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.667s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:21 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:59:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Deleted volume successfully.
Jul 02 04:59:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-460d4b70-39b2-4ae5-ab76-5322f820845a tempest-VolumeSnapshotQuotasNegativeTestJSON-1443403770 None] Lock "cinder-f31fc661-5591-4d27-a74d-753d868e75a4-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Flow 'volume_create_manager' (530f2178-0161-4726-b528-e2bda954d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9592c2e8-f156-406f-85f7-90f1c2f02046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9592c2e8-f156-406f-85f7-90f1c2f02046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-729845033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ce9b50-b3b5-4d15-88fa-677e8988ddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7477306db346fcbd9e545510e2813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:28Z,use_quota=True,user_id='1e37c475c1cc481683e488ecc5fa0c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475d499f-88d1-4096-99b6-57f9570a1d0c),volume_type_id=475d499f-88d1-4096-99b6-57f9570a1d0c)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d9fbca-eea9-47ec-8173-159a8d6681ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d9fbca-eea9-47ec-8173-159a8d6681ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bc20e0-afb7-45c9-95ac-be9057820423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bc20e0-afb7-45c9-95ac-be9057820423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ce9b50-b3b5-4d15-88fa-677e8988ddbe', 'volume_name': 'volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad940ef-e993-4176-8004-024fc3cfe92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad940ef-e993-4176-8004-024fc3cfe92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aec581a-d3b2-41b4-8f55-9329eb20a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Volume 44ce9b50-b3b5-4d15-88fa-677e8988ddbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe', 'volume_size': 1}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-729845033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ce9b50-b3b5-4d15-88fa-677e8988ddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7477306db346fcbd9e545510e2813c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:28Z,use_quota=True,user_id='1e37c475c1cc481683e488ecc5fa0c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475d499f-88d1-4096-99b6-57f9570a1d0c),volume_type_id=475d499f-88d1-4096-99b6-57f9570a1d0c)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Creating volume 44ce9b50-b3b5-4d15-88fa-677e8988ddbe {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:59:27 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:59:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:27 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe 1073741824
Jul 02 04:59:27 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:28 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe 1073741824" returned: 0 in 0.869s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:28 devstack sudo[100469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe
Jul 02 04:59:28 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:29 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" returned: 0 in 0.735s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aec581a-d3b2-41b4-8f55-9329eb20a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a83759d-f915-482b-90e5-9d14cc89eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Volume volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe (44ce9b50-b3b5-4d15-88fa-677e8988ddbe): created successfully
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a83759d-f915-482b-90e5-9d14cc89eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Flow 'volume_create_manager' (530f2178-0161-4726-b528-e2bda954d76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-58741710-6c2a-4cdb-a8a5-50048c492199 tempest-VolumeTypesAccessTest-1560357679 None] Created volume successfully.
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Acquiring lock "cinder-44ce9b50-b3b5-4d15-88fa-677e8988ddbe-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "cinder-44ce9b50-b3b5-4d15-88fa-677e8988ddbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Acquiring lock "cinder-quobyte-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "cinder-quobyte-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f74c0cd-fb96-4d59-aed9-caa8b2f2be61]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:30 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe
Jul 02 04:59:30 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:30 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" returned: 0 in 0.774s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:30 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe
Jul 02 04:59:30 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:31 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" returned: 0 in 0.671s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "cinder-quobyte-44ce9b50-b3b5-4d15-88fa-677e8988ddbe" released by "delete_volume" :: held 1.492s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:31 devstack cinder-volume[86158]: WARNING cinder.quota [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-951177949 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-951177949, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:59:31 devstack cinder-volume[86158]: WARNING cinder.quota [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-951177949 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-951177949, it is now deprecated. Please use the default quota class for default quota.
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Created reservations ['69420e19-01ec-449a-a40f-3ebf085daf9c', 'a3de9f3c-a4fa-437a-a5d9-a4ba44d31287', 'ebabbf15-7247-48f6-b476-4694672232a5', '90b5e418-7b55-467c-bc42-5a706143a84e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:31 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:59:31 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:32 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:59:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Deleted volume successfully.
Jul 02 04:59:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-757e97f3-bbec-44c4-ac1b-eb22284fdbaa tempest-VolumeTypesAccessTest-1560357679 None] Lock "cinder-44ce9b50-b3b5-4d15-88fa-677e8988ddbe-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:41 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=22,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Flow 'volume_create_manager' (fc5e1a78-9235-4f55-a03d-7769d6e2e456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b5ad26-1a41-49f6-919a-61716956546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b5ad26-1a41-49f6-919a-61716956546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-550315038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4c1d97-da54-4a4c-a5e0-e586bc0fa683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4849230cd969436c8e5d3d7069bbba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:43Z,use_quota=True,user_id='773deb40a4f3493dae3dad09c52cdd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f356d-706e-4fc6-97d9-bf57765b1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f356d-706e-4fc6-97d9-bf57765b1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03154488-8bae-43a5-9d7d-e71a680ea065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:42 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03154488-8bae-43a5-9d7d-e71a680ea065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce4c1d97-da54-4a4c-a5e0-e586bc0fa683', 'volume_name': 'volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa79f9f40>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0aa597-2c91-4f49-bd1a-ef4f68f6bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0aa597-2c91-4f49-bd1a-ef4f68f6bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81661df9-b5a4-427f-a6e0-c33aef605112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:43 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa79f9f40>}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Trying to clone ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 04:59:43 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Image download 20.69 MB at 20.69 MB/s
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[090cd447-6df2-4dea-a94b-b02fe8040f29]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:43 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD
Jul 02 04:59:43 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:44 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 is fetched for user 773deb40a4f3493dae3dad09c52cdd90. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec327fe-e53b-4cea-b751-dbd34706facf]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:44 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD
Jul 02 04:59:44 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:44 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-550315038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4c1d97-da54-4a4c-a5e0-e586bc0fa683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4849230cd969436c8e5d3d7069bbba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:43Z,use_quota=True,user_id='773deb40a4f3493dae3dad09c52cdd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Creating volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:59:44 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:59:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:44 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1073741824
Jul 02 04:59:44 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:45 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1073741824" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:45 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:45 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:46 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 0 in 0.637s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Attempting download of 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a354f66-ad60-4465-bf2c-76d6632e2847]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:46 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi
Jul 02 04:59:46 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:47 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi" returned: 0 in 0.799s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:47 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi
Jul 02 04:59:47 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:48 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi" returned: 1 in 0.716s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cdb7750-2f67-439d-ab9d-6580dacde6f8_ylgsztxi' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1230a3c-06a2-4ddc-bfdf-a7dce7a5a8bd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:48 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD
Jul 02 04:59:48 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:48 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] 3cdb7750-2f67-439d-ab9d-6580dacde6f8 was qcow2, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 04:59:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:48 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:48 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Flow 'volume_create_manager' (e0362b26-bf89-43a2-9220-5aa2119b65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeb2c6b-9caf-40cf-92c8-47f132247643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deeb2c6b-9caf-40cf-92c8-47f132247643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-719844722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42e1afa-3ec7-4b90-926d-2c08ba7f5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697dc8b833424ef9b40c6ad5730285af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:50Z,use_quota=True,user_id='e95c37fffd0242cc81915c9d36aa69f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a81ae6-1992-4352-b765-43c057cdcf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a81ae6-1992-4352-b765-43c057cdcf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c0fee0-52ae-4173-b67a-5dfe88b4e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c0fee0-52ae-4173-b67a-5dfe88b4e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42e1afa-3ec7-4b90-926d-2c08ba7f5b11', 'volume_name': 'volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23be9fab-2d0f-4416-93d7-38836334a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23be9fab-2d0f-4416-93d7-38836334a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55757d68-732b-4607-9299-46ae1ef7a619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:50 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Volume e42e1afa-3ec7-4b90-926d-2c08ba7f5b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11', 'volume_size': 1}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-719844722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42e1afa-3ec7-4b90-926d-2c08ba7f5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697dc8b833424ef9b40c6ad5730285af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T02:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T02:59:50Z,use_quota=True,user_id='e95c37fffd0242cc81915c9d36aa69f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Creating volume e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:59:50 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:50 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 1073741824
Jul 02 04:59:50 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:50 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 0 in 1.959s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cdb7750-2f67-439d-ab9d-6580dacde6f8_i68b83pvdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 04:59:50 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Converted 112.00 MB image at 57.13 MB/s
Jul 02 04:59:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:50 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1G
Jul 02 04:59:50 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:51 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 1073741824" returned: 0 in 0.919s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:51 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 1G" returned: 0 in 0.730s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:51 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11
Jul 02 04:59:51 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc863e74-3bd5-4e81-a73d-194130ba2af0]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:51 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:51 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:51 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:59:51 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:52 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" returned: 0 in 0.642s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55757d68-732b-4607-9299-46ae1ef7a619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8654e07d-8df0-42dc-b5fe-19c9304736b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:52 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Volume volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 (e42e1afa-3ec7-4b90-926d-2c08ba7f5b11): created successfully
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8654e07d-8df0-42dc-b5fe-19c9304736b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Flow 'volume_create_manager' (e0362b26-bf89-43a2-9220-5aa2119b65ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:52 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-75d5537f-9917-49ae-972f-5ff98ecfbd29 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Created volume successfully.
Jul 02 04:59:52 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 0 in 0.773s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:52 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:52 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:52 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.742s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 04:59:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 04:59:53 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 1 in 0.798s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Downloaded image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}])) to volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Temporary image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 for user 773deb40a4f3493dae3dad09c52cdd90 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Marking volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Copying metadata from image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 to ce4c1d97-da54-4a4c-a5e0-e586bc0fa683. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Creating volume glance metadata for volume ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 backed by image 3cdb7750-2f67-439d-ab9d-6580dacde6f8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81661df9-b5a4-427f-a6e0-c33aef605112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683', 'volume_size': 1, 'image_id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c4dabddbc8a4a729de11e83e2da74e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cdb7750-2f67-439d-ab9d-6580dacde6f8', 'created_at': datetime.datetime(2026, 7, 2, 2, 35, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 2, 35, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cdb7750-2f67-439d-ab9d-6580dacde6f8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa79f9f40>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6e4d88-ff9e-4576-8918-f5b1d5fef653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Volume volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 (ce4c1d97-da54-4a4c-a5e0-e586bc0fa683): created successfully
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6e4d88-ff9e-4576-8918-f5b1d5fef653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Flow 'volume_create_manager' (fc5e1a78-9235-4f55-a03d-7769d6e2e456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f75d4bc8-5d57-4956-ace3-0b63553f32f7 tempest-VolumesImageMetadata-302182891 None] Created volume successfully.
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Acquiring lock "cinder-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "cinder-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Acquiring lock "cinder-quobyte-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "cinder-quobyte-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc63a6c7-6842-4ef0-8b45-5970c774a636]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:53 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:53 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:54 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 0 in 0.743s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:54 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:54 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:55 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 1 in 0.736s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:55 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683
Jul 02 04:59:55 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71bd97-55fc-4329-b191-2baa714b2067]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:55 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11
Jul 02 04:59:55 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:55 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" returned: 0 in 0.661s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "cinder-quobyte-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683" released by "delete_volume" :: held 2.200s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:55 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Created reservations ['281c7d34-3ede-4be1-82c8-67e462d00b84', 'a6dd6d53-03d6-4fe2-ae3b-ca6993895146', 'fc5e737a-a151-4bcb-9e42-65b69c15efd1', 'e22a675e-a4db-4d97-a522-6ce8eceace28'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:56 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 04:59:56 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 04:59:56 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" returned: 0 in 0.799s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '412df6bb-3621-4be5-82e4-09ced5838438', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 04:59:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-3252a746-db2d-45ae-82d5-a4f1f39cf187 req-073b7998-3d60-4143-8dc6-a78622a85128 tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] attachment_update completed successfully.
Jul 02 04:59:56 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.656s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 04:59:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Deleted volume successfully.
Jul 02 04:59:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-74e59dfc-e674-4c50-939a-2c1134634c32 tempest-VolumesImageMetadata-302182891 None] Lock "cinder-ce4c1d97-da54-4a4c-a5e0-e586bc0fa683-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Flow 'volume_create_manager' (d0cdcecf-b4e6-4de0-a895-950782981042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e1c04-d73c-4a36-b84f-c8ca8d604e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e1c04-d73c-4a36-b84f-c8ca8d604e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1942164995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb2ffec-a118-4def-8cf9-e3c019e0ce11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ad16a444b1469dada9f5c50177f997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:00Z,use_quota=True,user_id='6d7f146a65b7420dbd7e0e4618ea6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25caeef0-6d5a-4dc6-a2ef-0e9e7505d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25caeef0-6d5a-4dc6-a2ef-0e9e7505d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1ce4a1-9296-46c9-874e-37cdb177f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1ce4a1-9296-46c9-874e-37cdb177f87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb2ffec-a118-4def-8cf9-e3c019e0ce11', 'volume_name': 'volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816ed7c8-b5f1-4626-9743-ef39e0dadff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816ed7c8-b5f1-4626-9743-ef39e0dadff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7efd5-7443-4b52-8b07-ca7dd65c1c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 04:59:59 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Volume bbb2ffec-a118-4def-8cf9-e3c019e0ce11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11', 'volume_size': 1}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T02:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1942164995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb2ffec-a118-4def-8cf9-e3c019e0ce11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ad16a444b1469dada9f5c50177f997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:00Z,use_quota=True,user_id='6d7f146a65b7420dbd7e0e4618ea6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Creating volume bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 04:59:59 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 04:59:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 04:59:59 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 1073741824
Jul 02 04:59:59 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:00 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 1073741824" returned: 0 in 0.820s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:00 devstack sudo[101048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11
Jul 02 05:00:00 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:01 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" returned: 0 in 0.668s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f7efd5-7443-4b52-8b07-ca7dd65c1c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440be651-ce41-4ec2-9d2d-587d9d95da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:01 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Volume volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 (bbb2ffec-a118-4def-8cf9-e3c019e0ce11): created successfully
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440be651-ce41-4ec2-9d2d-587d9d95da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Flow 'volume_create_manager' (d0cdcecf-b4e6-4de0-a895-950782981042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:01 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-217a2c8e-1e35-40b8-8f9f-ef59472932cb tempest-SnapshotMetadataTestJSON-1622064163 None] Created volume successfully.
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Creating offline snapshot 36075a73-f1c0-4c34-98a5-9fb498d40afd of volume bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[07038dfe-7201-495c-9dd7-2d5fe55fd3df]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:02 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11
Jul 02 05:00:02 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:02 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" returned: 0 in 0.778s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:02 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd 1G
Jul 02 05:00:02 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:02 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-738191b5-fd05-426e-89df-e140b951c35e req-d3208771-9dfb-4365-8e11-524c90d56c1f tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Terminate volume connection completed successfully.
Jul 02 05:00:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-738191b5-fd05-426e-89df-e140b951c35e req-d3208771-9dfb-4365-8e11-524c90d56c1f tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Deleting attachment 412df6bb-3621-4be5-82e4-09ced5838438. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:00:03 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd 1G" returned: 0 in 0.836s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:03 devstack sudo[101092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd
Jul 02 05:00:03 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:04 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd" returned: 0 in 0.687s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:04 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd is being set with open permissions: ugo+rw
Jul 02 05:00:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:04 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd
Jul 02 05:00:04 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:04 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd" returned: 0 in 0.641s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:04 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info
Jul 02 05:00:04 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "cinder-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "cinder-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "cinder-quobyte-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "cinder-quobyte-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e0199a-d850-4dd8-b515-ca8b3182022b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:05 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11
Jul 02 05:00:05 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:05 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info" returned: 0 in 0.658s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:05 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info is being set with open permissions: ugo+rw
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:05 devstack sudo[101105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info
Jul 02 05:00:05 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:05 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" returned: 0 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:05 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11
Jul 02 05:00:05 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:06 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.info" returned: 0 in 0.656s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2711b357-84aa-42b9-b048-b1dab7571ca9 tempest-SnapshotMetadataTestJSON-1622064163 None] Create snapshot completed successfully
Jul 02 05:00:06 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" returned: 0 in 0.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "cinder-quobyte-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11" released by "delete_volume" :: held 1.474s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Created reservations ['b9463377-0d5f-4415-8888-b1ce2fa83f52', '01290909-688c-42d9-bd01-360418ed8e77', 'ff9f8f1f-8ec1-4dd4-919c-0d9f18940d05', '87028303-6e27-4ba3-aed5-1bd00a941270'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:06 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:06 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:07 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.678s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Deleted volume successfully.
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-072eede0-702c-48aa-ba37-91caf0933fdf tempest-TestServerVolumeAttachScenarioOldVersion-1765396623 None] Lock "cinder-e42e1afa-3ec7-4b90-926d-2c08ba7f5b11-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "cinder-36075a73-f1c0-4c34-98a5-9fb498d40afd-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-36075a73-f1c0-4c34-98a5-9fb498d40afd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "cinder-quobyte-36075a73-f1c0-4c34-98a5-9fb498d40afd" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-36075a73-f1c0-4c34-98a5-9fb498d40afd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Deleting offline snapshot 36075a73-f1c0-4c34-98a5-9fb498d40afd of volume bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] snapshot_file for this snap is: volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd638a7-6303-4eaa-b6c1-75407a0f3580]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:08 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd
Jul 02 05:00:08 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:08 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd" returned: 0 in 0.898s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:00:08 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b5e89a-2290-4436-b596-cef119471408]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:09 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11
Jul 02 05:00:09 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:09 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" returned: 0 in 0.816s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:09 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd
Jul 02 05:00:09 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:10 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:10 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd
Jul 02 05:00:10 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:11 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11.36075a73-f1c0-4c34-98a5-9fb498d40afd" returned: 0 in 0.691s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-36075a73-f1c0-4c34-98a5-9fb498d40afd" released by "_delete_snapshot" :: held 3.305s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" released by "delete_snapshot" :: held 3.333s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Created reservations ['60e2fa8a-e21b-4b00-908f-49551b5dc069', '0b6317d4-ffb4-4c19-ae25-735e3e485640', 'a1663d57-552f-479f-8975-c536f7ec32f0', 'b62ee36c-a7dd-4ca4-b09d-111ea748892b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Delete snapshot completed successfully.
Jul 02 05:00:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-8c8dd421-f7b2-4019-b64e-d15c61ac396f tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-36075a73-f1c0-4c34-98a5-9fb498d40afd-delete_snapshot" released by "delete_snapshot" :: held 3.468s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "cinder-bbb2ffec-a118-4def-8cf9-e3c019e0ce11-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-bbb2ffec-a118-4def-8cf9-e3c019e0ce11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a2a65-a8e6-4279-89e7-ce921655cf96]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:12 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11
Jul 02 05:00:12 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:13 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" returned: 0 in 0.778s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:13 devstack sudo[101179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11
Jul 02 05:00:13 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:13 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" returned: 0 in 0.645s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-quobyte-bbb2ffec-a118-4def-8cf9-e3c019e0ce11" released by "delete_volume" :: held 1.482s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Created reservations ['0b9207d4-5b81-4409-b346-07c9597a867b', '1663c34c-dfa6-4c24-8e1b-0d57a7366296', '0dfe4984-c41a-4bec-af87-127b38fad196', '9438fea5-a1a5-4883-b07f-800dbd1bf381'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:13 devstack sudo[101182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:13 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:14 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:14 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:14 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Deleted volume successfully.
Jul 02 05:00:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-def0c947-8bb2-41a8-90ee-8ab805851fac tempest-SnapshotMetadataTestJSON-1622064163 None] Lock "cinder-bbb2ffec-a118-4def-8cf9-e3c019e0ce11-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:20 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Flow 'volume_create_manager' (e23a5027-b2cb-4814-9dff-f33eecaa9f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19bb468-105c-46f3-b069-dd46be401b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19bb468-105c-46f3-b069-dd46be401b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-48195521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86facab2243b48b083b975124c357030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:21Z,use_quota=True,user_id='5f73aca1c44c41bab8d7ebae09fe2758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a411fa15-655c-4e3a-a6bb-6d627365af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a411fa15-655c-4e3a-a6bb-6d627365af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f758b65d-950b-49c7-a88d-8c2441cb26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f758b65d-950b-49c7-a88d-8c2441cb26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b', 'volume_name': 'volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0767859-1ea1-4357-a70c-c99a15b294b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0767859-1ea1-4357-a70c-c99a15b294b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efe8f20-2f91-4051-8cbd-abdc97bfb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:21 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Volume 5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b', 'volume_size': 1}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-48195521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86facab2243b48b083b975124c357030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:21Z,use_quota=True,user_id='5f73aca1c44c41bab8d7ebae09fe2758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Creating volume 5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:00:21 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:00:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:21 devstack sudo[101192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b 1073741824
Jul 02 05:00:21 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:22 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b 1073741824" returned: 0 in 0.972s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:22 devstack sudo[101198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b
Jul 02 05:00:22 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:22 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efe8f20-2f91-4051-8cbd-abdc97bfb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e5986f-2953-4dcb-a589-7b6db07aab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:22 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Volume volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b (5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b): created successfully
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e5986f-2953-4dcb-a589-7b6db07aab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Flow 'volume_create_manager' (e23a5027-b2cb-4814-9dff-f33eecaa9f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bca16826-9aa4-4e31-8f63-32aab86f5d8f tempest-AbsoluteLimitsTests-540210126 None] Created volume successfully.
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Acquiring lock "cinder-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "cinder-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Acquiring lock "cinder-quobyte-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "cinder-quobyte-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c9937-dbcd-4fcb-ab97-dcee040c865b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:23 devstack sudo[101202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b
Jul 02 05:00:23 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:24 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" returned: 0 in 0.776s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:24 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b
Jul 02 05:00:24 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:24 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" returned: 0 in 0.689s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "cinder-quobyte-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b" released by "delete_volume" :: held 1.505s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Created reservations ['372b2fea-878b-478c-a98d-34bc244cd2f0', 'bb3d658a-c3af-4d3a-8f7d-55379d8330b5', '0d610637-ae9c-4cee-aa3d-f39977e226c0', '19968deb-dd01-4092-b7fd-1842c8a34597'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:24 devstack sudo[101210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:24 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:25 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.666s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:25 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:25 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Deleted volume successfully.
Jul 02 05:00:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-51433cf8-3ccd-402b-9c15-51fbf8efe962 tempest-AbsoluteLimitsTests-540210126 None] Lock "cinder-5ad6e1c9-fd7a-41c6-87e2-7ce41c1d7e4b-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Flow 'volume_create_manager' (58ba7a93-0618-499c-9442-7d04aab22c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa4aabc-a585-4d08-95db-55fa3f16723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa4aabc-a585-4d08-95db-55fa3f16723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-712775603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc6bb28-8a19-42d4-8560-b292bcf37e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6c0998eae6418daa11d5165921bdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:31Z,use_quota=True,user_id='14fc28425add489e99203b44f8294b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb6a7dd-7cff-4c67-8d9b-5db4be823024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb6a7dd-7cff-4c67-8d9b-5db4be823024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c8b8f6-65c0-49f4-a270-9ad30eaeb88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c8b8f6-65c0-49f4-a270-9ad30eaeb88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc6bb28-8a19-42d4-8560-b292bcf37e06', 'volume_name': 'volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f75ecd6-6334-4e4f-be8c-2648aa8af517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f75ecd6-6334-4e4f-be8c-2648aa8af517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244e78a2-5afb-4097-9719-c7d1bc63303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Volume cbc6bb28-8a19-42d4-8560-b292bcf37e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06', 'volume_size': 1}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-712775603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc6bb28-8a19-42d4-8560-b292bcf37e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6c0998eae6418daa11d5165921bdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:31Z,use_quota=True,user_id='14fc28425add489e99203b44f8294b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Creating volume cbc6bb28-8a19-42d4-8560-b292bcf37e06 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:00:31 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:00:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:31 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 1073741824
Jul 02 05:00:31 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:32 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 1073741824" returned: 0 in 0.915s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:32 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06
Jul 02 05:00:32 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:33 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06" returned: 0 in 0.670s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244e78a2-5afb-4097-9719-c7d1bc63303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166d5100-4db5-4def-835e-0b157838b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Volume volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 (cbc6bb28-8a19-42d4-8560-b292bcf37e06): created successfully
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166d5100-4db5-4def-835e-0b157838b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Flow 'volume_create_manager' (58ba7a93-0618-499c-9442-7d04aab22c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9fc79caf-a329-4284-88e9-e948cdd586c4 tempest-VolumesTransfersTest-462000691 None] Created volume successfully.
Jul 02 05:00:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4ad0ced6-1770-429f-9ec9-693ed5148397 tempest-VolumesTransfersTest-640658116 None] Transfer volume completed successfully.
Jul 02 05:00:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "cinder-cbc6bb28-8a19-42d4-8560-b292bcf37e06-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:34 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-cbc6bb28-8a19-42d4-8560-b292bcf37e06-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "cinder-quobyte-cbc6bb28-8a19-42d4-8560-b292bcf37e06" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-quobyte-cbc6bb28-8a19-42d4-8560-b292bcf37e06" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee958df5-72e0-4b4d-86b1-6ffd1c3de5c1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:35 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06
Jul 02 05:00:35 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:35 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06" returned: 0 in 0.822s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:35 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06
Jul 02 05:00:35 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:36 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbc6bb28-8a19-42d4-8560-b292bcf37e06" returned: 0 in 0.701s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-quobyte-cbc6bb28-8a19-42d4-8560-b292bcf37e06" released by "delete_volume" :: held 1.608s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Created reservations ['4b76b9a5-518e-4c3c-b458-aba71a9b60bd', '66e23b1a-e1dd-459b-bf0c-c2e0d50fc28b', 'd2ca8b05-3739-476c-86fa-388b26572dd5', 'cf5e59e3-57c7-48e6-b1ca-9b8694d214bd'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:36 devstack sudo[101233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:36 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:37 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.739s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Deleted volume successfully.
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c1a32650-f518-467c-a8e0-249670cd2906 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-cbc6bb28-8a19-42d4-8560-b292bcf37e06-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Flow 'volume_create_manager' (cafe66ae-46f0-4a65-8f63-b086a2672806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca96c54-b431-4e6e-9a0e-47da3546cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca96c54-b431-4e6e-9a0e-47da3546cf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1922958755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6631e37-6ecb-4508-a234-911b598b2e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6c0998eae6418daa11d5165921bdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:38Z,use_quota=True,user_id='14fc28425add489e99203b44f8294b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d814fb89-f01d-4efc-9c4b-abb01d71bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d814fb89-f01d-4efc-9c4b-abb01d71bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e3618a-c086-4d0f-895e-8c871ad1cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e3618a-c086-4d0f-895e-8c871ad1cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6631e37-6ecb-4508-a234-911b598b2e8f', 'volume_name': 'volume-a6631e37-6ecb-4508-a234-911b598b2e8f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4522142f-0796-4e76-8369-d1a35bdfbda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4522142f-0796-4e76-8369-d1a35bdfbda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fe8600-d3dd-4d78-b5c5-7a225dd110a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Volume a6631e37-6ecb-4508-a234-911b598b2e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6631e37-6ecb-4508-a234-911b598b2e8f', 'volume_size': 1}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1922958755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6631e37-6ecb-4508-a234-911b598b2e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6c0998eae6418daa11d5165921bdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:38Z,use_quota=True,user_id='14fc28425add489e99203b44f8294b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Creating volume a6631e37-6ecb-4508-a234-911b598b2e8f {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:00:37 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:00:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:37 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f 1073741824
Jul 02 05:00:37 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:38 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f 1073741824" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:38 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f
Jul 02 05:00:38 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:39 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f" returned: 0 in 0.670s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fe8600-d3dd-4d78-b5c5-7a225dd110a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6631e37-6ecb-4508-a234-911b598b2e8f', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f291bdda-d2cf-447e-90fb-039284e325f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Volume volume-a6631e37-6ecb-4508-a234-911b598b2e8f (a6631e37-6ecb-4508-a234-911b598b2e8f): created successfully
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f291bdda-d2cf-447e-90fb-039284e325f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Flow 'volume_create_manager' (cafe66ae-46f0-4a65-8f63-b086a2672806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1b6f0b76-4cb6-46f2-ad01-0238d5a862c5 tempest-VolumesTransfersTest-462000691 None] Created volume successfully.
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "cinder-a6631e37-6ecb-4508-a234-911b598b2e8f-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-a6631e37-6ecb-4508-a234-911b598b2e8f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "cinder-quobyte-a6631e37-6ecb-4508-a234-911b598b2e8f" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-quobyte-a6631e37-6ecb-4508-a234-911b598b2e8f" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea4d122-60f1-4059-9eb1-d33de8c6c0cb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:40 devstack sudo[101245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f
Jul 02 05:00:40 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:41 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f" returned: 0 in 0.832s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:41 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f
Jul 02 05:00:41 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:41 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a6631e37-6ecb-4508-a234-911b598b2e8f" returned: 0 in 0.682s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-quobyte-a6631e37-6ecb-4508-a234-911b598b2e8f" released by "delete_volume" :: held 1.606s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=71,cinder:INSERT=19,cinder:UPDATE=68,cinder:DELETE=8 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:00:41 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Created reservations ['a3163042-4fac-4235-85fd-bf5b595cc9cf', 'cc7f4d59-0a08-4d9e-badd-3f2624fdc076', '6b5ba458-8417-44fa-a626-767853bf4919', 'd4b86502-8f9a-458a-83cc-a45d91cdf81d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:42 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:42 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:42 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.714s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:42 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Deleted volume successfully.
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=80,cinder:SELECT=59,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:00:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e1dbb091-f643-4507-b66f-b1df8789c5a9 tempest-VolumesTransfersTest-896565925 None] Lock "cinder-a6631e37-6ecb-4508-a234-911b598b2e8f-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Flow 'volume_create_manager' (a904dcdb-6608-48db-bc4e-8fb11da2bb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e0cca0-6915-49a2-8f2d-acfb6dbca929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e0cca0-6915-49a2-8f2d-acfb6dbca929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1704847396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632d4bd0-176a-450a-902e-3aa5df13b680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c72adc5a3a224af89636102a42ca538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:48Z,use_quota=True,user_id='3a4df776c11c4cbd8dfe3ef5566a664d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48247dc8-7df1-4145-99b3-75cc947c8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48247dc8-7df1-4145-99b3-75cc947c8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a449ae-050b-435b-88d9-d178af0e7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a449ae-050b-435b-88d9-d178af0e7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632d4bd0-176a-450a-902e-3aa5df13b680', 'volume_name': 'volume-632d4bd0-176a-450a-902e-3aa5df13b680', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c151b965-532c-4b35-bb7e-3c7fa5242011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c151b965-532c-4b35-bb7e-3c7fa5242011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf1facf-8c80-445f-a4f8-406219461ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:48 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Volume 632d4bd0-176a-450a-902e-3aa5df13b680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632d4bd0-176a-450a-902e-3aa5df13b680', 'volume_size': 1}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1704847396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632d4bd0-176a-450a-902e-3aa5df13b680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c72adc5a3a224af89636102a42ca538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:48Z,use_quota=True,user_id='3a4df776c11c4cbd8dfe3ef5566a664d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Creating volume 632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:00:48 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:00:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:48 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 1073741824
Jul 02 05:00:48 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:49 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 1073741824" returned: 0 in 0.907s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:49 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:00:49 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Flow 'volume_create_manager' (1d58cf50-ee98-4f9f-b933-5bcdfa1ae165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9119afe-0009-4d0b-827a-02d408b337fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9119afe-0009-4d0b-827a-02d408b337fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-738372372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c72a559a7444f58202ca529c1a91f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:49Z,use_quota=True,user_id='6ead7b59f37248e298c8bca6ace28622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86ddfda-c2a2-4bb8-9d0d-e91782e2bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86ddfda-c2a2-4bb8-9d0d-e91782e2bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a6583-8a1f-4375-b955-636ebec177f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a6583-8a1f-4375-b955-636ebec177f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0', 'volume_name': 'volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619808eb-3f03-44d9-b09c-16b197fee6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619808eb-3f03-44d9-b09c-16b197fee6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63664b65-78a6-4a1b-84a8-2c53cf10249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Volume a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0', 'volume_size': 1}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:49 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.750s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-738372372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c72a559a7444f58202ca529c1a91f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:49Z,use_quota=True,user_id='6ead7b59f37248e298c8bca6ace28622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Creating volume a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:00:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:49 devstack sudo[101313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 1073741824
Jul 02 05:00:49 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf1facf-8c80-445f-a4f8-406219461ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632d4bd0-176a-450a-902e-3aa5df13b680', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260f7626-0ce7-488c-9acb-4d9489afdf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Volume volume-632d4bd0-176a-450a-902e-3aa5df13b680 (632d4bd0-176a-450a-902e-3aa5df13b680): created successfully
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260f7626-0ce7-488c-9acb-4d9489afdf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Flow 'volume_create_manager' (a904dcdb-6608-48db-bc4e-8fb11da2bb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ebd79693-e3a6-460a-b90b-05ee0058114a tempest-VolumesCloneTest-534181582 None] Created volume successfully.
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Flow 'volume_create_manager' (5d99e3ea-869a-4e14-844e-e04ca567fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271e17f-75e5-422f-ae43-face161f6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271e17f-75e5-422f-ae43-face161f6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-66483369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2dcf0f-74e4-4399-96e6-5bb9d17a586c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c72adc5a3a224af89636102a42ca538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:00:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=632d4bd0-176a-450a-902e-3aa5df13b680,status='creating',terminated_at=None,updated_at=2026-07-02T03:00:51Z,use_quota=True,user_id='3a4df776c11c4cbd8dfe3ef5566a664d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb188c9-9de6-4f29-9841-ab69498ed87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb188c9-9de6-4f29-9841-ab69498ed87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f2c3a-effb-4152-bb22-b3f3f8294bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f2c3a-effb-4152-bb22-b3f3f8294bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7a2dcf0f-74e4-4399-96e6-5bb9d17a586c', 'volume_name': 'volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c', 'volume_size': 2, 'source_volid': '632d4bd0-176a-450a-902e-3aa5df13b680', 'source_volstatus': 'available'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee394087-c1f7-4029-b17b-400f518d3f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee394087-c1f7-4029-b17b-400f518d3f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1657df-2f9b-4def-9546-d3257b999b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:50 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Volume 7a2dcf0f-74e4-4399-96e6-5bb9d17a586c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c', 'volume_size': 2, 'source_volid': '632d4bd0-176a-450a-902e-3aa5df13b680', 'source_volstatus': 'available'}
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:50 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 1073741824" returned: 0 in 1.093s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:51 devstack sudo[101322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:00:51 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:51 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.685s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.831s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:51 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Cloning volume 632d4bd0-176a-450a-902e-3aa5df13b680 to volume 7a2dcf0f-74e4-4399-96e6-5bb9d17a586c
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63664b65-78a6-4a1b-84a8-2c53cf10249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152a0e12-7841-4bc0-94e9-c06198b294ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:00:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Volume volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 (a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0): created successfully
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152a0e12-7841-4bc0-94e9-c06198b294ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Flow 'volume_create_manager' (1d58cf50-ee98-4f9f-b933-5bcdfa1ae165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Creating offline snapshot a2f39a1c-1c93-4cb9-91d0-e5635d352734 of volume 632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:00:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bd2e1de5-923f-46b2-82ca-bbf82e6af7c5 tempest-TestStampPattern-563437723 None] Created volume successfully.
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a813a9ec-1d3f-4b54-8432-e52467556bb6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:51 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:00:51 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:51 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:00:51 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:52 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.686s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:00:52 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.801s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:52 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 1G
Jul 02 05:00:52 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:53 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 1G" returned: 0 in 0.827s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632d4bd0-176a-450a-902e-3aa5df13b680 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:53 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632d4bd0-176a-450a-902e-3aa5df13b680 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:00:53 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:54 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632d4bd0-176a-450a-902e-3aa5df13b680 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.671s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:54 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 is being set with open permissions: ugo+rw
Jul 02 05:00:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:54 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:00:54 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:54 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.652s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:54 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info
Jul 02 05:00:54 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:55 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:55 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info is being set with open permissions: ugo+rw
Jul 02 05:00:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:55 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info
Jul 02 05:00:55 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:56 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.info" returned: 0 in 0.698s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] snapshot: a2f39a1c-1c93-4cb9-91d0-e5635d352734, volume: 7a2dcf0f-74e4-4399-96e6-5bb9d17a586c,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f529e2be-c4c1-4152-b437-3428e649dd0b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:56 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:00:56 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:57 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.833s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632d4bd0-176a-450a-902e-3aa5df13b680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0606ccaf-eec4-43a6-bf40-029836b902e4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:57 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:00:57 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:00:57 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.857s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 05:00:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:00:58 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c
Jul 02 05:00:58 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:03 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" returned: 0 in 5.073s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f372d-3a21-4707-8c42-ca984e2d7b39]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:03 devstack sudo[101447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:01:03 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:04 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 1.091s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:01:04 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Converted 1024.00 MB image at 201.81 MB/s
Jul 02 05:01:04 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c is being set with open permissions: ugo+rw
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:04 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c
Jul 02 05:01:04 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:INSERT=3,cinder:UPDATE=15,cinder:SELECT=11 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:01:04 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" returned: 0 in 0.661s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" released by "_copy_volume_from_snapshot" :: held 8.648s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-quobyte-a2f39a1c-1c93-4cb9-91d0-e5635d352734" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-a2f39a1c-1c93-4cb9-91d0-e5635d352734" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Deleting offline snapshot a2f39a1c-1c93-4cb9-91d0-e5635d352734 of volume 632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] snapshot_file for this snap is: volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5ff73-d9b8-4fd3-978a-bdfb5a7acdee]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:05 devstack sudo[101473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:01:05 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:05 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.835s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632d4bd0-176a-450a-902e-3aa5df13b680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:01:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd85140-61cc-4f4b-b0a2-d765a15301c4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:05 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:01:05 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:06 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.788s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:06 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:01:06 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:07 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:07 devstack sudo[101488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734
Jul 02 05:01:07 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:08 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680.a2f39a1c-1c93-4cb9-91d0-e5635d352734" returned: 0 in 0.642s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-a2f39a1c-1c93-4cb9-91d0-e5635d352734" released by "_delete_snapshot" :: held 3.158s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.397s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1657df-2f9b-4def-9546-d3257b999b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c', 'volume_size': 2, 'source_volid': '632d4bd0-176a-450a-902e-3aa5df13b680', 'source_volstatus': 'available'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2292cb96-e5a1-4c13-91cf-04a25a227337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Volume volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c (7a2dcf0f-74e4-4399-96e6-5bb9d17a586c): created successfully
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2292cb96-e5a1-4c13-91cf-04a25a227337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Flow 'volume_create_manager' (5d99e3ea-869a-4e14-844e-e04ca567fefa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-69905021-71e5-4c5f-ac99-82021083d2d0 tempest-VolumesCloneTest-534181582 None] Created volume successfully.
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "cinder-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" acquired by "delete_volume" :: waited 0.036s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[521567e5-f557-4c3d-bd46-e375611c0c09]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:09 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c
Jul 02 05:01:09 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:10 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" returned: 0 in 0.800s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:10 devstack sudo[101498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c
Jul 02 05:01:10 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:10 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" returned: 0 in 0.655s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c" released by "delete_volume" :: held 1.503s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:10 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Created reservations ['8cca1a38-c45c-4158-8dc6-78fde6dab190', 'f9344f86-7965-4e8a-a5f2-ef3654ee4206', 'c7261cc8-3d95-4b79-bbda-9f828b373517', '8fb82dba-cea2-4605-98a5-5b65fa631f6c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:11 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:01:11 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-632d4bd0-176a-450a-902e-3aa5df13b680-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "cinder-632d4bd0-176a-450a-902e-3aa5df13b680-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:11 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.683s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Acquiring lock "cinder-quobyte-632d4bd0-176a-450a-902e-3aa5df13b680" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Deleted volume successfully.
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-632d4bd0-176a-450a-902e-3aa5df13b680" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe25fee7-a2da-4417-b53c-eaf8802c7ad3 tempest-VolumesCloneTest-534181582 None] Lock "cinder-7a2dcf0f-74e4-4399-96e6-5bb9d17a586c-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b75a6ee-3e9c-452f-8305-a9619cf6dda7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:11 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:01:11 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:12 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.765s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:12 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680
Jul 02 05:01:12 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:13 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-632d4bd0-176a-450a-902e-3aa5df13b680" returned: 0 in 0.642s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "cinder-quobyte-632d4bd0-176a-450a-902e-3aa5df13b680" released by "delete_volume" :: held 1.474s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Created reservations ['1ca12bee-2eb0-4353-8e94-17deab2b9424', '1744bccb-46b9-45cc-8c6d-d6a1ba6dcb33', '06d40b88-734f-4b9f-89d7-5e1029b01586', '790de823-9c7b-4afe-a1e6-60b609d81486'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:13 devstack sudo[101513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:01:13 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:14 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.672s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:14 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:01:14 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Deleted volume successfully.
Jul 02 05:01:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c9b6ac96-29ee-4e6c-aa52-c2458236e97a tempest-VolumesCloneTest-534181582 None] Lock "cinder-632d4bd0-176a-450a-902e-3aa5df13b680-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Flow 'volume_create_manager' (32a7ea97-a596-45ba-a322-efb4c4080313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60df2737-2de6-4a56-bfe9-f143fdb8a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60df2737-2de6-4a56-bfe9-f143fdb8a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-656304101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec40bdbd-d18f-412b-b4fa-175f0f5c121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953fccabe3f8408b948fd0443edd0fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:17Z,use_quota=True,user_id='521580ae36e642e3891b702ce53d4853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7560d6-1f60-4511-a74e-2db1209389c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7560d6-1f60-4511-a74e-2db1209389c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54db37df-cdfd-458e-b073-dadfc0dbce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54db37df-cdfd-458e-b073-dadfc0dbce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec40bdbd-d18f-412b-b4fa-175f0f5c121d', 'volume_name': 'volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d', 'volume_size': 2}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc6e594-3c60-44fb-a4d7-9f9848571853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc6e594-3c60-44fb-a4d7-9f9848571853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5408b267-4097-4093-a6ad-246a24981c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:16 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Volume ec40bdbd-d18f-412b-b4fa-175f0f5c121d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d', 'volume_size': 2}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-656304101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec40bdbd-d18f-412b-b4fa-175f0f5c121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953fccabe3f8408b948fd0443edd0fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:17Z,use_quota=True,user_id='521580ae36e642e3891b702ce53d4853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Creating volume ec40bdbd-d18f-412b-b4fa-175f0f5c121d {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:01:16 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:01:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d 2147483648 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:16 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d 2147483648
Jul 02 05:01:16 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:17 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d 2147483648" returned: 0 in 0.851s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:17 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d
Jul 02 05:01:17 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:18 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" returned: 0 in 0.634s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5408b267-4097-4093-a6ad-246a24981c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d', 'volume_size': 2}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d7819a-4ad4-4ea5-9842-6ab456a634be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:18 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Volume volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d (ec40bdbd-d18f-412b-b4fa-175f0f5c121d): created successfully
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d7819a-4ad4-4ea5-9842-6ab456a634be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Flow 'volume_create_manager' (32a7ea97-a596-45ba-a322-efb4c4080313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e2de3b3c-6f76-4a69-bf13-f5e733566fe3 tempest-VolumesCloneNegativeTest-1249978446 None] Created volume successfully.
Jul 02 05:01:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Acquiring lock "cinder-ec40bdbd-d18f-412b-b4fa-175f0f5c121d-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "cinder-ec40bdbd-d18f-412b-b4fa-175f0f5c121d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Acquiring lock "cinder-quobyte-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "cinder-quobyte-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[be65175a-013f-4d9b-8531-506b907ebd6a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:19 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d
Jul 02 05:01:19 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:19 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" returned: 0 in 0.759s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:19 devstack sudo[101554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d
Jul 02 05:01:19 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:20 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" returned: 0 in 0.646s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "cinder-quobyte-ec40bdbd-d18f-412b-b4fa-175f0f5c121d" released by "delete_volume" :: held 1.442s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Created reservations ['60e20f8f-a6a7-41df-8cf9-dfb3f6f2ab0d', '158b05f4-8ede-40db-8e79-d2ec292c86a9', 'd6ac9424-b8f5-49c1-bd31-a0e6a880b01b', '688b076d-f710-4f79-ada9-7d65f8d5deff'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:20 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:01:20 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:21 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.657s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:21 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:01:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Deleted volume successfully.
Jul 02 05:01:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0618de54-5187-44a2-aa32-192e35432a1c tempest-VolumesCloneNegativeTest-1249978446 None] Lock "cinder-ec40bdbd-d18f-412b-b4fa-175f0f5c121d-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:01:30 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=30,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:01:31 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f13dc-b1e2-4b7f-ad4b-7de57ce37f16]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:32 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:01:32 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:32 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.847s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a55e057-fe5d-4bb6-8ea9-9a54af4e3e89', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 05:01:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-94226c8e-9680-4a38-99e9-ac1cdd5ee9fd req-7dcf66a1-40c9-440e-b255-4d7e99b98f8f tempest-TestStampPattern-563437723 None] attachment_update completed successfully.
Jul 02 05:01:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-6dffa387-9b77-454b-ba9f-b1af1c0e7fce req-0ccdf4a0-72d8-4b83-8778-2f2ac8e4adb8 tempest-TestStampPattern-563437723 None] Terminate volume connection completed successfully.
Jul 02 05:01:41 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-6dffa387-9b77-454b-ba9f-b1af1c0e7fce req-0ccdf4a0-72d8-4b83-8778-2f2ac8e4adb8 tempest-TestStampPattern-563437723 None] Deleting attachment 1a55e057-fe5d-4bb6-8ea9-9a54af4e3e89. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:01:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Creating offline snapshot e125da35-da90-4b22-b0ca-ba1a57e1e91e of volume a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:01:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30df2b-89c8-4ed3-8526-427ea6bfd2d3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:43 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:01:43 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:44 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.757s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:44 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e 1G
Jul 02 05:01:44 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:45 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e 1G" returned: 0 in 0.819s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:45 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:01:45 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:45 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.724s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:45 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e is being set with open permissions: ugo+rw
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:01:45 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:01:45 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (fe8cdc48-3193-4ade-9973-5c3d40ad10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40217174-8135-4cf5-bf43-08be1535827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40217174-8135-4cf5-bf43-08be1535827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-159666203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdff9da3-c7d7-4ba8-972c-757782201c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:46Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f8bb93-4931-4dfd-830e-2aa2e835d64d),volume_type_id=05f8bb93-4931-4dfd-830e-2aa2e835d64d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3674bde-c64f-4aa7-8549-2e9c65af47d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3674bde-c64f-4aa7-8549-2e9c65af47d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec72c02-c7aa-4fa9-9487-92110853f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec72c02-c7aa-4fa9-9487-92110853f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdff9da3-c7d7-4ba8-972c-757782201c04', 'volume_name': 'volume-cdff9da3-c7d7-4ba8-972c-757782201c04', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b99ff5-01f4-4842-aae4-9d8b461854db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b99ff5-01f4-4842-aae4-9d8b461854db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14e6a38-69d2-4b1d-9494-ddb42762ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:45 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Volume cdff9da3-c7d7-4ba8-972c-757782201c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdff9da3-c7d7-4ba8-972c-757782201c04', 'volume_size': 1}
Jul 02 05:01:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (4fecab94-9901-4f61-93c4-3331740d19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f17cf8-57a5-4bc9-9755-2f9a53b3baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f17cf8-57a5-4bc9-9755-2f9a53b3baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566791849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa0648-c84a-49f6-94f1-f3e8ff547842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:46Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848909c-421f-4b7d-b14e-aeb33af6f9e9),volume_type_id=9848909c-421f-4b7d-b14e-aeb33af6f9e9)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552cbabe-032a-4845-99de-a170131c9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552cbabe-032a-4845-99de-a170131c9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f54678-d818-4489-960c-6f66bc17ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f54678-d818-4489-960c-6f66bc17ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fa0648-c84a-49f6-94f1-f3e8ff547842', 'volume_name': 'volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05b514-687d-473e-acbe-55b6522104d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb05b514-687d-473e-acbe-55b6522104d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f26b171-dc0b-484d-8d58-b774a4d62c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Volume e0fa0648-c84a-49f6-94f1-f3e8ff547842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842', 'volume_size': 1}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:46 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.687s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:46 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info
Jul 02 05:01:46 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (0703960f-e9b5-4efa-8466-f065bfec390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99107db6-7811-4c99-af13-9f0004715893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99107db6-7811-4c99-af13-9f0004715893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-616095411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234718c0-a86b-456c-80cf-71b99b26f3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:47Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c2df3f5-9f96-4c08-894f-846c541a1ab9),volume_type_id=4c2df3f5-9f96-4c08-894f-846c541a1ab9)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff61ab9d-451f-4edf-b8cf-c71a24ffeded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff61ab9d-451f-4edf-b8cf-c71a24ffeded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d99884-807e-43d0-b459-86d43cb05d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:46 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d99884-807e-43d0-b459-86d43cb05d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '234718c0-a86b-456c-80cf-71b99b26f3b2', 'volume_name': 'volume-234718c0-a86b-456c-80cf-71b99b26f3b2', 'volume_size': 1, 'image_id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--627035153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd144727acaba42acafb5e740371606fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'created_at': datetime.datetime(2026, 7, 2, 3, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab2842150>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98146fd1-36da-44c1-9d28-3275680bc1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98146fd1-36da-44c1-9d28-3275680bc1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29690061-a235-4bce-ac4a-3a8bb86f2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:47 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Volume 234718c0-a86b-456c-80cf-71b99b26f3b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-234718c0-a86b-456c-80cf-71b99b26f3b2', 'volume_size': 1, 'image_id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--627035153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd144727acaba42acafb5e740371606fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'created_at': datetime.datetime(2026, 7, 2, 3, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab2842150>}
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Trying to clone 234718c0-a86b-456c-80cf-71b99b26f3b2 from image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 05:01:47 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:47 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info is being set with open permissions: ugo+rw
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:47 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info
Jul 02 05:01:47 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:47 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.info" returned: 0 in 0.753s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.510s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.054s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-159666203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdff9da3-c7d7-4ba8-972c-757782201c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:46Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f8bb93-4931-4dfd-830e-2aa2e835d64d),volume_type_id=05f8bb93-4931-4dfd-830e-2aa2e835d64d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Creating volume cdff9da3-c7d7-4ba8-972c-757782201c04 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:01:48 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:48 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 1073741824
Jul 02 05:01:48 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:48 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-63994a6a-2070-440c-a5ea-0cad73a8d06e tempest-TestStampPattern-563437723 None] Create snapshot completed successfully
Jul 02 05:01:48 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 1073741824" returned: 0 in 0.927s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:49 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04
Jul 02 05:01:49 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:49 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566791849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa0648-c84a-49f6-94f1-f3e8ff547842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:46Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9848909c-421f-4b7d-b14e-aeb33af6f9e9),volume_type_id=9848909c-421f-4b7d-b14e-aeb33af6f9e9)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Creating volume e0fa0648-c84a-49f6-94f1-f3e8ff547842 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:01:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:49 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 1073741824
Jul 02 05:01:49 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14e6a38-69d2-4b1d-9494-ddb42762ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdff9da3-c7d7-4ba8-972c-757782201c04', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50226776-9cd4-4962-b79d-f10819233e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Volume volume-cdff9da3-c7d7-4ba8-972c-757782201c04 (cdff9da3-c7d7-4ba8-972c-757782201c04): created successfully
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50226776-9cd4-4962-b79d-f10819233e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (fe8cdc48-3193-4ade-9973-5c3d40ad10ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-68c1b4bf-71c4-4e72-8de6-9e82ddde15da tempest-TestInstancesWithCinderVolumes-132065257 None] Created volume successfully.
Jul 02 05:01:50 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD, size 20.69 MB, duration 3.44 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 05:01:50 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Image download 20.69 MB at 6.02 MB/s
Jul 02 05:01:50 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 1073741824" returned: 0 in 0.879s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b58627-b7de-4f4b-a3d9-9b5d0bd59ae1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:50 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842
Jul 02 05:01:50 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:50 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD
Jul 02 05:01:50 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:51 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842" returned: 0 in 0.666s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f26b171-dc0b-484d-8d58-b774a4d62c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:51 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e161a44a-0a39-41ff-8e2f-1aff89a19e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Temporary image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 is fetched for user 4e8b9f7e8c5542b5a8f5641bb7b806d2. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 05:01:51 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Volume volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 (e0fa0648-c84a-49f6-94f1-f3e8ff547842): created successfully
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e161a44a-0a39-41ff-8e2f-1aff89a19e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (4fecab94-9901-4f61-93c4-3331740d19ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4f301b72-0161-405c-8a53-8a0e576d5064 tempest-TestInstancesWithCinderVolumes-132065257 None] Created volume successfully.
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe39ec5-23b1-4c50-85e1-4022e911f809]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:51 devstack sudo[102108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD
Jul 02 05:01:51 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:51 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:01:51 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:52 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-616095411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234718c0-a86b-456c-80cf-71b99b26f3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d144727acaba42acafb5e740371606fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:47Z,use_quota=True,user_id='4e8b9f7e8c5542b5a8f5641bb7b806d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c2df3f5-9f96-4c08-894f-846c541a1ab9),volume_type_id=4c2df3f5-9f96-4c08-894f-846c541a1ab9)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Creating volume 234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:01:52 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:52 devstack sudo[102121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1073741824
Jul 02 05:01:52 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:52 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.677s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:01:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:01:53 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1073741824" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:53 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:01:53 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:53 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 0.662s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Attempting download of ca4f7cb1-29cc-49e2-a7c8-4840558460f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}])) to volume 234718c0-a86b-456c-80cf-71b99b26f3b2. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e9df9-ecca-44e8-b333-8bc582f614b7]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:53 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c
Jul 02 05:01:53 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:54 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c" returned: 0 in 0.755s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:54 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c
Jul 02 05:01:54 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:55 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c" returned: 1 in 0.717s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_7tr7mt_c' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:01:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[164429de-db48-4f20-a21c-3e1670f38f24]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:55 devstack sudo[102168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD
Jul 02 05:01:55 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:56 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:56 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] ca4f7cb1-29cc-49e2-a7c8-4840558460f7 was qcow2, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 05:01:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:56 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:01:56 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:57 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 1.904s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:57 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca4f7cb1-29cc-49e2-a7c8-4840558460f7_oc90w62hdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:01:57 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Converted 112.00 MB image at 58.79 MB/s
Jul 02 05:01:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:57 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1G
Jul 02 05:01:57 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Flow 'volume_create_manager' (aa87efcf-f4bb-42ef-8024-81aa2767ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d899063-d4e9-41b0-981c-8903616861fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d899063-d4e9-41b0-981c-8903616861fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-221114970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29fab12-1c99-4e55-8e97-ac000564023c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c72a559a7444f58202ca529c1a91f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e125da35-da90-4b22-b0ca-ba1a57e1e91e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:01:58Z,use_quota=True,user_id='6ead7b59f37248e298c8bca6ace28622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59e669d-9d5e-4f3b-b65f-69fd8b0ceb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59e669d-9d5e-4f3b-b65f-69fd8b0ceb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d71c9d9-8d3c-4882-aec0-0e286aa56507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d71c9d9-8d3c-4882-aec0-0e286aa56507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd29fab12-1c99-4e55-8e97-ac000564023c', 'volume_name': 'volume-d29fab12-1c99-4e55-8e97-ac000564023c', 'volume_size': 1, 'snapshot_id': 'e125da35-da90-4b22-b0ca-ba1a57e1e91e'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae04ae29-e125-4f88-a7c7-872495382e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae04ae29-e125-4f88-a7c7-872495382e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cf0552-4197-4fd2-a139-45b53406caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:01:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Volume d29fab12-1c99-4e55-8e97-ac000564023c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d29fab12-1c99-4e55-8e97-ac000564023c', 'volume_size': 1, 'snapshot_id': 'e125da35-da90-4b22-b0ca-ba1a57e1e91e'}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:58 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e-d29fab12-1c99-4e55-8e97-ac000564023c" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 1G" returned: 0 in 0.756s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e-d29fab12-1c99-4e55-8e97-ac000564023c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Creating volume d29fab12-1c99-4e55-8e97-ac000564023c from snapshot e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] snapshot: e125da35-da90-4b22-b0ca-ba1a57e1e91e, volume: d29fab12-1c99-4e55-8e97-ac000564023c,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2655b00-e2a8-474e-ac4d-048216186ad4]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950873a-6c34-4a08-a357-a26efe1e90b1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:58 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:01:58 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:58 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:01:58 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:59 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 0.825s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:59 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.802s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd941102-c9f4-49df-85f1-304b0b61b961]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:01:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:01:59 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:01:59 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:01:59 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:01:59 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:00 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 1 in 0.775s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Downloaded image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}])) to volume 234718c0-a86b-456c-80cf-71b99b26f3b2 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Temporary image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 for user 4e8b9f7e8c5542b5a8f5641bb7b806d2 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Marking volume 234718c0-a86b-456c-80cf-71b99b26f3b2 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Copying metadata from image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 to 234718c0-a86b-456c-80cf-71b99b26f3b2. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Creating volume glance metadata for volume 234718c0-a86b-456c-80cf-71b99b26f3b2 backed by image ca4f7cb1-29cc-49e2-a7c8-4840558460f7 with: {'image_id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'image_name': 'tempest-scenario-img--627035153', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 05:02:00 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.790s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:00 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c
Jul 02 05:02:00 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29690061-a235-4bce-ac4a-3a8bb86f2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234718c0-a86b-456c-80cf-71b99b26f3b2', 'volume_size': 1, 'image_id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--627035153', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd144727acaba42acafb5e740371606fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4f7cb1-29cc-49e2-a7c8-4840558460f7', 'created_at': datetime.datetime(2026, 7, 2, 3, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4f7cb1-29cc-49e2-a7c8-4840558460f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab2842150>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bfeb70-6920-4937-9f38-8341cda429d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:02:00 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Volume volume-234718c0-a86b-456c-80cf-71b99b26f3b2 (234718c0-a86b-456c-80cf-71b99b26f3b2): created successfully
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bfeb70-6920-4937-9f38-8341cda429d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:02:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Flow 'volume_create_manager' (0703960f-e9b5-4efa-8466-f065bfec390a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:02:00 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3cb6a924-9d5d-468d-9865-c079db2defac tempest-TestInstancesWithCinderVolumes-132065257 None] Created volume successfully.
Jul 02 05:02:06 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c" returned: 0 in 5.919s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:06 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[87395186-3eed-471b-ac9a-8cd97e6a7976]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:02:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:06 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:02:06 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:07 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 1.128s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:07 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:02:07 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Converted 1024.00 MB image at 172.97 MB/s
Jul 02 05:02:07 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c is being set with open permissions: ugo+rw
Jul 02 05:02:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:07 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c
Jul 02 05:02:07 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:08 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c" returned: 0 in 0.936s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" released by "_copy_volume_from_snapshot" :: held 9.707s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e-d29fab12-1c99-4e55-8e97-ac000564023c" released by "_create_volume_from_snapshot" :: held 9.746s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.764s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cf0552-4197-4fd2-a139-45b53406caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29fab12-1c99-4e55-8e97-ac000564023c', 'volume_size': 1, 'snapshot_id': 'e125da35-da90-4b22-b0ca-ba1a57e1e91e'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1e8821-dfc8-4e8c-bd97-0ca1fe1ae5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:02:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Volume volume-d29fab12-1c99-4e55-8e97-ac000564023c (d29fab12-1c99-4e55-8e97-ac000564023c): created successfully
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1e8821-dfc8-4e8c-bd97-0ca1fe1ae5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:02:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Flow 'volume_create_manager' (aa87efcf-f4bb-42ef-8024-81aa2767ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:02:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-095aa2f8-ff44-4fe6-a2ca-6ccd1eef2610 tempest-TestStampPattern-563437723 None] Created volume successfully.
Jul 02 05:02:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:02:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:02:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1aaa5c-40c3-4e55-9c04-3b8716cf811c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:02:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:09 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:02:09 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:10 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 0.862s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:10 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:02:10 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:11 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 1 in 0.782s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:02:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.693s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:02:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-234718c0-a86b-456c-80cf-71b99b26f3b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ea4538e-1086-4a64-82e6-2883b657469f', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 05:02:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-f81bb5b2-61a4-414e-83d3-18042a145143 req-ceae88ad-a025-4269-9cd2-ed3681b9114f tempest-TestInstancesWithCinderVolumes-132065257 None] attachment_update completed successfully.
Jul 02 05:02:21 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=25,cinder:UPDATE=14,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:02:21 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=34,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:02:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:02:46 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6596f9-a4c1-4e43-93f0-99f6cc20be64]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:49 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04
Jul 02 05:02:49 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:49 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04" returned: 0 in 0.757s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:02:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-cdff9da3-c7d7-4ba8-972c-757782201c04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf434537-874e-4222-bcaf-12f41590af1e', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 05:02:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-27f7fdee-7ebb-403c-ac98-bab3ba45d049 req-43f7e278-58ce-4247-97cd-4ae3b57bbba0 tempest-TestInstancesWithCinderVolumes-132065257 None] attachment_update completed successfully.
Jul 02 05:02:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:02:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:02:51 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:02:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:02:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:02:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de977b-98b6-49d5-97c4-ec556c1c57d3]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:02:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:57 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842
Jul 02 05:02:57 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:58 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842" returned: 0 in 0.765s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1e73eb5-39f1-41dc-a125-c6bdf78d318b', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 05:02:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-4fc30c45-0b49-4899-bcb0-c2d6eb748a59 req-5cc51def-2f6d-4d9b-91b0-806d230fedeb tempest-TestInstancesWithCinderVolumes-132065257 None] attachment_update completed successfully.
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d01119-f263-4a70-8a97-df9ba05a35b0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:02:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:02:59 devstack sudo[103009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c
Jul 02 05:02:59 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:02:59 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root
Jul 02 05:02:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c" returned: 0 in 0.770s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:02:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:02:59 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e', 'name': 'volume-d29fab12-1c99-4e55-8e97-ac000564023c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '100b0d93-1b28-4061-9a6c-2bbbef84c733', 'enforce_multipath': True} {{(pid=86158) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 02 05:02:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-e06544cd-d078-4168-a22f-bf5db5b4db11 req-8245e3df-e5d1-4674-94a1-ea85da59b927 tempest-TestStampPattern-563437723 None] attachment_update completed successfully.
Jul 02 05:03:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-fb3c8c2b-c207-4b21-acfc-99893f843767 req-d72e916e-4cad-4a27-ae91-4086893e5c34 tempest-TestStampPattern-563437723 None] Terminate volume connection completed successfully.
Jul 02 05:03:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-fb3c8c2b-c207-4b21-acfc-99893f843767 req-d72e916e-4cad-4a27-ae91-4086893e5c34 tempest-TestStampPattern-563437723 None] Deleting attachment 100b0d93-1b28-4061-9a6c-2bbbef84c733. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:03:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-aa2ac61a-64d9-4f99-8d00-e33dd83fecce req-26f84cd8-7b1c-4cbf-b8a1-f0f70bdbe683 tempest-TestInstancesWithCinderVolumes-132065257 None] Terminate volume connection completed successfully.
Jul 02 05:03:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-aa2ac61a-64d9-4f99-8d00-e33dd83fecce req-26f84cd8-7b1c-4cbf-b8a1-f0f70bdbe683 tempest-TestInstancesWithCinderVolumes-132065257 None] Deleting attachment cf434537-874e-4222-bcaf-12f41590af1e. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:03:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-cdff9da3-c7d7-4ba8-972c-757782201c04-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-cdff9da3-c7d7-4ba8-972c-757782201c04-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:08 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-quobyte-cdff9da3-c7d7-4ba8-972c-757782201c04" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-cdff9da3-c7d7-4ba8-972c-757782201c04" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:09 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a814e-06e1-4198-bf0e-dc1c7470ceb0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:09 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04
Jul 02 05:03:09 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:09 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04" returned: 0 in 0.846s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:09 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04
Jul 02 05:03:09 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:10 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cdff9da3-c7d7-4ba8-972c-757782201c04" returned: 0 in 0.903s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-cdff9da3-c7d7-4ba8-972c-757782201c04" released by "delete_volume" :: held 1.810s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:10 devstack cinder-volume[86158]: WARNING cinder.quota [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015717694-1432678379 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015717694-1432678379, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:10 devstack cinder-volume[86158]: WARNING cinder.quota [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015717694-1432678379 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1015717694-1432678379, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Created reservations ['c562a2e5-eed2-4cf6-b415-5e2ab27cdeed', 'c7c7b96a-c622-483d-9a0b-492b028b2e39', '056c62a4-9bd3-420c-a4dd-5706bcab9dfd', '5fed92dd-1d35-4117-a587-7f3a33c2a4ff'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:10 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:10 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:11 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.695s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:11 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Deleted volume successfully.
Jul 02 05:03:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-cba41ebe-b806-419b-b1c3-cd073b4eebb1 tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-cdff9da3-c7d7-4ba8-972c-757782201c04-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-0d5f74e1-ff8c-46ba-88cf-4282e89551cb req-e6116e2c-b3ad-4284-b91e-bd2eb8edf2e2 tempest-TestInstancesWithCinderVolumes-132065257 None] Terminate volume connection completed successfully.
Jul 02 05:03:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-0d5f74e1-ff8c-46ba-88cf-4282e89551cb req-e6116e2c-b3ad-4284-b91e-bd2eb8edf2e2 tempest-TestInstancesWithCinderVolumes-132065257 None] Deleting attachment c1e73eb5-39f1-41dc-a125-c6bdf78d318b. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-e0fa0648-c84a-49f6-94f1-f3e8ff547842-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-e0fa0648-c84a-49f6-94f1-f3e8ff547842-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-quobyte-e0fa0648-c84a-49f6-94f1-f3e8ff547842" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-e0fa0648-c84a-49f6-94f1-f3e8ff547842" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b0d294-86f5-496b-939c-9c7235d74c1e]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:15 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842
Jul 02 05:03:15 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-d29fab12-1c99-4e55-8e97-ac000564023c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "cinder-d29fab12-1c99-4e55-8e97-ac000564023c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[9070444e-7e13-4d5e-b886-365d49293502]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:16 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842" returned: 0 in 0.805s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:16 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842
Jul 02 05:03:16 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:16 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c
Jul 02 05:03:16 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:17 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e0fa0648-c84a-49f6-94f1-f3e8ff547842" returned: 0 in 0.783s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-e0fa0648-c84a-49f6-94f1-f3e8ff547842" released by "delete_volume" :: held 1.633s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:17 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c" returned: 0 in 0.852s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:17 devstack cinder-volume[86158]: WARNING cinder.quota [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55373224-945530383 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55373224-945530383, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:17 devstack cinder-volume[86158]: WARNING cinder.quota [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55373224-945530383 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55373224-945530383, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:17 devstack sudo[103165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c
Jul 02 05:03:17 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Created reservations ['79ee7dd1-d2fe-40f9-890e-b44cc41250be', '6ed7e912-2b50-49f1-ab57-1b789a2edb77', '5d31dfe0-0cbd-4d10-bae1-ec845ec91efc', '0f8d4f0d-d12e-4bfe-8684-e3b53540374f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:17 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:17 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:18 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d29fab12-1c99-4e55-8e97-ac000564023c" returned: 0 in 0.776s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-d29fab12-1c99-4e55-8e97-ac000564023c" released by "delete_volume" :: held 1.687s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Created reservations ['1c0fd199-5590-42f9-8fd9-4fea07dc6375', '0a9afaf7-67bc-4358-bece-7cef2fe429de', '5646ca82-d888-4e1d-ba52-c9bad15cf696', '6ffefe32-5325-4355-b280-15729faacc3f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:18 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.774s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Deleted volume successfully.
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d07b1bc2-5ad4-400e-a3ed-72ae56841f4c tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-e0fa0648-c84a-49f6-94f1-f3e8ff547842-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:18 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:18 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-e125da35-da90-4b22-b0ca-ba1a57e1e91e-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-e125da35-da90-4b22-b0ca-ba1a57e1e91e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:19 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.690s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:19 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Deleted volume successfully.
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6bb7370f-e1e9-48eb-9910-d8c9830421df tempest-TestStampPattern-563437723 None] Lock "cinder-d29fab12-1c99-4e55-8e97-ac000564023c-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Deleting offline snapshot e125da35-da90-4b22-b0ca-ba1a57e1e91e of volume a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] snapshot_file for this snap is: volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa1ce2e-435b-4478-96dd-49c40f478fc5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:19 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:03:19 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:19 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.893s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:03:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf4fc1-09db-4a7a-91f5-3c9af1c0b872]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:20 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:03:20 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:20 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.826s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:20 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:03:20 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:21 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.820s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:21 devstack sudo[103233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e
Jul 02 05:03:21 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [req-d7b66c5f-6cee-4e89-855b-8c1d665de422 req-8091351e-08f4-40fe-89eb-e01f3f1ffe38 tempest-TestInstancesWithCinderVolumes-132065257 None] Terminate volume connection completed successfully.
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [req-d7b66c5f-6cee-4e89-855b-8c1d665de422 req-8091351e-08f4-40fe-89eb-e01f3f1ffe38 tempest-TestInstancesWithCinderVolumes-132065257 None] Deleting attachment 7ea4538e-1086-4a64-82e6-2883b657469f. {{(pid=86158) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 02 05:03:22 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0.e125da35-da90-4b22-b0ca-ba1a57e1e91e" returned: 0 in 0.659s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-e125da35-da90-4b22-b0ca-ba1a57e1e91e" released by "_delete_snapshot" :: held 3.322s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" released by "delete_snapshot" :: held 3.358s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Created reservations ['be9abddc-46da-4e5e-a110-115d057c96d4', 'a212d502-615a-496d-9caa-2df8b6fc0cd0', 'de6885c7-0870-45f9-893a-68c6202ea92f', 'be7b3fe0-1ae5-4f9b-af09-413b1a76af31'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Delete snapshot completed successfully.
Jul 02 05:03:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-06c4d87c-fe89-4102-9001-45d1c69ed75c tempest-TestStampPattern-563437723 None] Lock "cinder-e125da35-da90-4b22-b0ca-ba1a57e1e91e-delete_snapshot" released by "delete_snapshot" :: held 3.493s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-234718c0-a86b-456c-80cf-71b99b26f3b2-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-234718c0-a86b-456c-80cf-71b99b26f3b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "cinder-quobyte-234718c0-a86b-456c-80cf-71b99b26f3b2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-234718c0-a86b-456c-80cf-71b99b26f3b2" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb1586-f479-4a82-a049-d67075b1800e]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:25 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:03:25 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:26 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 0.759s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:26 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:03:26 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:27 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 1 in 0.786s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:27 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2
Jul 02 05:03:27 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:27 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-234718c0-a86b-456c-80cf-71b99b26f3b2" returned: 0 in 0.637s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-quobyte-234718c0-a86b-456c-80cf-71b99b26f3b2" released by "delete_volume" :: held 2.242s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:28 devstack cinder-volume[86158]: WARNING cinder.quota [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1195206507-1636523618 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1195206507-1636523618, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:28 devstack cinder-volume[86158]: WARNING cinder.quota [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1195206507-1636523618 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1195206507-1636523618, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Created reservations ['d1877c7e-c14f-4ecb-8628-3f1ef8d5f1e4', 'f5b94d34-0ee0-4fea-baea-b1517e35ae1d', '106edbed-66e8-44b0-bdb4-2c41b6dcdc26', '561e1b97-2bc7-498b-8e29-75bc71a6df1d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:28 devstack sudo[103291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:28 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:28 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Deleted volume successfully.
Jul 02 05:03:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3dd7a257-b535-4706-abed-9236a03243fe tempest-TestInstancesWithCinderVolumes-132065257 None] Lock "cinder-234718c0-a86b-456c-80cf-71b99b26f3b2-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "cinder-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Acquiring lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927df57-f82c-4b22-9a0f-509f0a78e214]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:30 devstack sudo[103295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:03:30 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:31 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.799s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:31 devstack sudo[103302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0
Jul 02 05:03:31 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:32 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" returned: 0 in 0.642s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "cinder-quobyte-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0" released by "delete_volume" :: held 1.537s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Created reservations ['d608c26c-bd09-4e02-887b-93e61caee3d5', '95464aea-97e7-4389-9383-aca8e38ee468', '8795b63a-b9a0-4922-9885-6af9d2ed0ec6', '7ce804c5-dc26-485c-9799-7e248845041a'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:32 devstack sudo[103305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:32 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:32 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.675s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:32 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Deleted volume successfully.
Jul 02 05:03:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3205dbc5-70f9-44d0-9983-caaf7a91b523 tempest-TestStampPattern-563437723 None] Lock "cinder-a7aaaa70-e078-4ec9-9a5b-4f89833cc6d0-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:03:42 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=52,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:03:43 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Flow 'volume_create_manager' (22d4f64f-4ac6-43d0-b9c7-19a82e005485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541f534e-60f8-45a6-becb-d86412097a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541f534e-60f8-45a6-becb-d86412097a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a811820e-0df7-4401-978b-a5deb3e85dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f71cffc206f4113a1c89b28f947d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:03:46Z,use_quota=True,user_id='fadca2f205294cfa978dcfabea95f0cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faab1d40-b089-4c67-a907-2a67cd1ba2fb),volume_type_id=faab1d40-b089-4c67-a907-2a67cd1ba2fb)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2dac15-8d28-4fd1-b6e8-2637775429c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2dac15-8d28-4fd1-b6e8-2637775429c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c145e-979b-488e-961e-a13cbe17895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c145e-979b-488e-961e-a13cbe17895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a811820e-0df7-4401-978b-a5deb3e85dd1', 'volume_name': 'volume-a811820e-0df7-4401-978b-a5deb3e85dd1', 'volume_size': 1, 'image_id': '72f15808-8363-49f1-a890-b11c79be0018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3af6e855f9ee0000911d6df2aae4720', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f71cffc206f4113a1c89b28f947d596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdec45f9863411d1addec93586aa1c4f3e8b9bddf0813623b8fe00d7743e113bc9ff1bb71b1465781d5d16f295a1d2f64295e76115b2a8aef6e830feccd5b673', 'id': '72f15808-8363-49f1-a890-b11c79be0018', 'created_at': datetime.datetime(2026, 7, 2, 3, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72f15808-8363-49f1-a890-b11c79be0018/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa7b7a390>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca223eb-67c9-429b-bee0-e5ba01dbc8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca223eb-67c9-429b-bee0-e5ba01dbc8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdefd19a-b74e-464d-982e-52fc9c80ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:46 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Volume a811820e-0df7-4401-978b-a5deb3e85dd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a811820e-0df7-4401-978b-a5deb3e85dd1', 'volume_size': 1, 'image_id': '72f15808-8363-49f1-a890-b11c79be0018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3af6e855f9ee0000911d6df2aae4720', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f71cffc206f4113a1c89b28f947d596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdec45f9863411d1addec93586aa1c4f3e8b9bddf0813623b8fe00d7743e113bc9ff1bb71b1465781d5d16f295a1d2f64295e76115b2a8aef6e830feccd5b673', 'id': '72f15808-8363-49f1-a890-b11c79be0018', 'created_at': datetime.datetime(2026, 7, 2, 3, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72f15808-8363-49f1-a890-b11c79be0018/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa7b7a390>}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Trying to clone a811820e-0df7-4401-978b-a5deb3e85dd1 from image 72f15808-8363-49f1-a890-b11c79be0018 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 05:03:46 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b88c1-2358-4228-a8be-22d46886a20c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:46 devstack sudo[103316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:46 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:47 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:47 devstack sudo[103320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:47 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:48 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:48 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Temporary image 72f15808-8363-49f1-a890-b11c79be0018 is fetched for user fadca2f205294cfa978dcfabea95f0cc. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 05:03:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef677559-a99b-4bc2-90b4-111ed5fb5728]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:48 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:48 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:48 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:49 devstack sudo[103371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:49 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:49 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 1 in 0.703s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a811820e-0df7-4401-978b-a5deb3e85dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f71cffc206f4113a1c89b28f947d596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:03:46Z,use_quota=True,user_id='fadca2f205294cfa978dcfabea95f0cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(faab1d40-b089-4c67-a907-2a67cd1ba2fb),volume_type_id=faab1d40-b089-4c67-a907-2a67cd1ba2fb)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Creating volume a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:03:49 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:03:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:49 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1073741824
Jul 02 05:03:49 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:50 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1073741824" returned: 0 in 0.787s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:50 devstack sudo[103382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:50 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:51 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 0 in 0.622s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Attempting download of 72f15808-8363-49f1-a890-b11c79be0018 ((None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}])) to volume a811820e-0df7-4401-978b-a5deb3e85dd1. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f7302-208e-4689-85b9-d00e34927e0f]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:51 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l
Jul 02 05:03:51 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:51 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:03:51 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:51 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l" returned: 0 in 0.701s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:52 devstack sudo[103392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l
Jul 02 05:03:52 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:52 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.648s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:03:52 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l" returned: 1 in 0.709s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72f15808-8363-49f1-a890-b11c79be0018_0bjscc0l' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ac8e6-04d3-4547-bfe6-606ee433f362]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:52 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:52 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:53 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:53 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD
Jul 02 05:03:53 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:54 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] 72f15808-8363-49f1-a890-b11c79be0018 was raw, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:54 devstack sudo[103408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:54 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:54 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 0 in 0.724s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72f15808-8363-49f1-a890-b11c79be0018_2950i8sfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:03:54 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 05:03:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:54 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1G
Jul 02 05:03:54 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:55 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 1G" returned: 0 in 0.666s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e804af-d380-4483-b60a-1e7542f03967]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:55 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:55 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:56 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 0 in 0.728s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:56 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:56 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:56 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 1 in 0.735s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Downloaded image 72f15808-8363-49f1-a890-b11c79be0018 ((None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}])) to volume a811820e-0df7-4401-978b-a5deb3e85dd1 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Temporary image 72f15808-8363-49f1-a890-b11c79be0018 for user fadca2f205294cfa978dcfabea95f0cc is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Marking volume a811820e-0df7-4401-978b-a5deb3e85dd1 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Copying metadata from image 72f15808-8363-49f1-a890-b11c79be0018 to a811820e-0df7-4401-978b-a5deb3e85dd1. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 05:03:56 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Creating volume glance metadata for volume a811820e-0df7-4401-978b-a5deb3e85dd1 backed by image 72f15808-8363-49f1-a890-b11c79be0018 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '72f15808-8363-49f1-a890-b11c79be0018', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c3af6e855f9ee0000911d6df2aae4720', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdefd19a-b74e-464d-982e-52fc9c80ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a811820e-0df7-4401-978b-a5deb3e85dd1', 'volume_size': 1, 'image_id': '72f15808-8363-49f1-a890-b11c79be0018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72f15808-8363-49f1-a890-b11c79be0018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3af6e855f9ee0000911d6df2aae4720', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f71cffc206f4113a1c89b28f947d596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdec45f9863411d1addec93586aa1c4f3e8b9bddf0813623b8fe00d7743e113bc9ff1bb71b1465781d5d16f295a1d2f64295e76115b2a8aef6e830feccd5b673', 'id': '72f15808-8363-49f1-a890-b11c79be0018', 'created_at': datetime.datetime(2026, 7, 2, 3, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72f15808-8363-49f1-a890-b11c79be0018/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777aa7b7a390>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078bb908-4613-4b75-b149-58bee0835f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:03:57 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Volume volume-a811820e-0df7-4401-978b-a5deb3e85dd1 (a811820e-0df7-4401-978b-a5deb3e85dd1): created successfully
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078bb908-4613-4b75-b149-58bee0835f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Flow 'volume_create_manager' (22d4f64f-4ac6-43d0-b9c7-19a82e005485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:03:57 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-91a80421-ad41-4c0e-a3e4-d10bbd05f030 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Created volume successfully.
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Acquiring lock "cinder-a811820e-0df7-4401-978b-a5deb3e85dd1-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "cinder-a811820e-0df7-4401-978b-a5deb3e85dd1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Acquiring lock "cinder-quobyte-a811820e-0df7-4401-978b-a5deb3e85dd1" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "cinder-quobyte-a811820e-0df7-4401-978b-a5deb3e85dd1" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ae028-dedb-412a-900d-5444cbc9e9b1]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:58 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:58 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:58 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 0 in 0.733s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:58 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:58 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:03:59 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Jul 02 05:03:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 1 in 0.743s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:03:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:03:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:03:59 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1
Jul 02 05:03:59 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:00 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a811820e-0df7-4401-978b-a5deb3e85dd1" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "cinder-quobyte-a811820e-0df7-4401-978b-a5deb3e85dd1" released by "delete_volume" :: held 2.173s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:00 devstack cinder-volume[86158]: WARNING cinder.quota [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:04:00 devstack cinder-volume[86158]: WARNING cinder.quota [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Created reservations ['52cdf265-2346-4e69-880e-15e4a71e6a7d', 'f32d746e-7e64-48e1-910f-65df10c19d69', 'f65fb984-a027-488c-95d3-453d4a67ad7b', '03683167-413a-4faf-97cd-608c0480e50b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:00 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:00 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:00 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.624s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:00 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Deleted volume successfully.
Jul 02 05:04:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-6c5ef492-f6da-4e09-b73f-620487ba18f6 tempest-VolumeAndVolumeTypeFromImageTest-1584237251 None] Lock "cinder-a811820e-0df7-4401-978b-a5deb3e85dd1-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (f8569835-8dfc-4292-8aa0-a39a7361720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f658dd6-8db8-44f5-8ad8-7e577269b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f658dd6-8db8-44f5-8ad8-7e577269b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704633053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e72d82-2cd5-483f-b06f-15ef19431e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:05Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee282f-3b4f-4a2c-a6ca-d9c6c13bf9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee282f-3b4f-4a2c-a6ca-d9c6c13bf9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a1db33-c030-4659-9690-9e24da76b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a1db33-c030-4659-9690-9e24da76b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e72d82-2cd5-483f-b06f-15ef19431e07', 'volume_name': 'volume-a4e72d82-2cd5-483f-b06f-15ef19431e07', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabff924-80a1-4040-a37e-c515f85f51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabff924-80a1-4040-a37e-c515f85f51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f937a-02bf-4dd9-bcdc-8547a98d1ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Volume a4e72d82-2cd5-483f-b06f-15ef19431e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e72d82-2cd5-483f-b06f-15ef19431e07', 'volume_size': 1}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704633053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e72d82-2cd5-483f-b06f-15ef19431e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:05Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Creating volume a4e72d82-2cd5-483f-b06f-15ef19431e07 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:05 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:05 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 1073741824
Jul 02 05:04:05 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (5c2c553a-c07d-4a7a-a422-8431ff45eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fad000-f902-4525-841e-d8c5fb648a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fad000-f902-4525-841e-d8c5fb648a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-533837009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841ecad6-b499-420f-a02a-31845642ace5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2018ee-190d-41ec-984c-8da8d855c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2018ee-190d-41ec-984c-8da8d855c730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0558191-7394-4da9-9821-fe54f1f912cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0558191-7394-4da9-9821-fe54f1f912cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841ecad6-b499-420f-a02a-31845642ace5', 'volume_name': 'volume-841ecad6-b499-420f-a02a-31845642ace5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9193a43-1081-481d-a1da-467df91c1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9193a43-1081-481d-a1da-467df91c1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e242fe70-4835-4ab0-8142-68a6185f47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Volume 841ecad6-b499-420f-a02a-31845642ace5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841ecad6-b499-420f-a02a-31845642ace5', 'volume_size': 1}
Jul 02 05:04:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (456a5ebf-4fd9-4615-ab18-219816746826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5025f8-d378-4041-b1b8-6cb491ffa70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5025f8-d378-4041-b1b8-6cb491ffa70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850574311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c9f1d9-51f3-4f1b-beed-5b39b5049da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ded194-7af4-45a6-a54f-a9d0ae0b6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ded194-7af4-45a6-a54f-a9d0ae0b6546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3660c2-c1ee-40e5-97d7-370598a22162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3660c2-c1ee-40e5-97d7-370598a22162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c9f1d9-51f3-4f1b-beed-5b39b5049da7', 'volume_name': 'volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e019da-cd89-44c6-8a1a-c5a4792b3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e019da-cd89-44c6-8a1a-c5a4792b3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df3784-f746-49f0-8d9d-b4cc857add3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Volume 75c9f1d9-51f3-4f1b-beed-5b39b5049da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7', 'volume_size': 1}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:06 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 1073741824" returned: 0 in 0.937s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:06 devstack sudo[103449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07
Jul 02 05:04:06 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (fda75297-7ee3-4bdc-8caf-bbccc35c18b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39b1866-773d-473e-aca6-03dbcf13d785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39b1866-773d-473e-aca6-03dbcf13d785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422628654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7201d533-66ee-42dd-b81c-f3f7474fe0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f52650-cd25-4ece-8499-dccfb16544d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f52650-cd25-4ece-8499-dccfb16544d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c8dc22-4d6f-40d1-970e-f62c61d4a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c8dc22-4d6f-40d1-970e-f62c61d4a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7201d533-66ee-42dd-b81c-f3f7474fe0e3', 'volume_name': 'volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e0175f-e137-4824-bb74-bbe820f1bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e0175f-e137-4824-bb74-bbe820f1bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3524451b-3d71-405c-90f7-27a949c01145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Volume 7201d533-66ee-42dd-b81c-f3f7474fe0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3', 'volume_size': 1}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (4d82f5f8-2435-495d-8f0b-02ed82be8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859bcc3-1941-4e12-b436-980ab7641875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859bcc3-1941-4e12-b436-980ab7641875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77359645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c65a187-33b3-4edb-8c39-9c25dd81a482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:07Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f817e-18fd-414a-8131-715089cd8dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f817e-18fd-414a-8131-715089cd8dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732e0b8c-46ad-444c-aef0-5a46891716a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732e0b8c-46ad-444c-aef0-5a46891716a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c65a187-33b3-4edb-8c39-9c25dd81a482', 'volume_name': 'volume-2c65a187-33b3-4edb-8c39-9c25dd81a482', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad7dbeb-d2e3-41fa-8627-d354df1c0dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad7dbeb-d2e3-41fa-8627-d354df1c0dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4795844b-5078-44ba-9677-c50e7f66b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:06 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Volume 2c65a187-33b3-4edb-8c39-9c25dd81a482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c65a187-33b3-4edb-8c39-9c25dd81a482', 'volume_size': 1}
Jul 02 05:04:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:07 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07" returned: 0 in 0.650s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-533837009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841ecad6-b499-420f-a02a-31845642ace5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Creating volume 841ecad6-b499-420f-a02a-31845642ace5 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:07 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f937a-02bf-4dd9-bcdc-8547a98d1ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e72d82-2cd5-483f-b06f-15ef19431e07', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:07 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 1073741824
Jul 02 05:04:07 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2def0f-6578-4db9-8f1d-6f63f3702fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:07 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Volume volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 (a4e72d82-2cd5-483f-b06f-15ef19431e07): created successfully
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2def0f-6578-4db9-8f1d-6f63f3702fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (f8569835-8dfc-4292-8aa0-a39a7361720f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d1de2c47-529f-41de-ade1-e30813e05cdd tempest-CreateVolumesFromImageTest-1739668065 None] Created volume successfully.
Jul 02 05:04:07 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 1073741824" returned: 0 in 0.813s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:07 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5
Jul 02 05:04:07 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:08 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5" returned: 0 in 0.641s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.407s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850574311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c9f1d9-51f3-4f1b-beed-5b39b5049da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Creating volume 75c9f1d9-51f3-4f1b-beed-5b39b5049da7 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:08 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:08 devstack sudo[103460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 1073741824
Jul 02 05:04:08 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e242fe70-4835-4ab0-8142-68a6185f47c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841ecad6-b499-420f-a02a-31845642ace5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d231d953-32a7-414c-8700-48dd1fcb63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:08 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Volume volume-841ecad6-b499-420f-a02a-31845642ace5 (841ecad6-b499-420f-a02a-31845642ace5): created successfully
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d231d953-32a7-414c-8700-48dd1fcb63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:08 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (5c2c553a-c07d-4a7a-a422-8431ff45eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:08 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-764fcc4f-7704-4a12-8c1f-00f562562598 tempest-CreateVolumesFromImageTest-1739668065 None] Created volume successfully.
Jul 02 05:04:09 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 1073741824" returned: 0 in 0.797s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:09 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7
Jul 02 05:04:09 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:09 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" returned: 0 in 0.624s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.458s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422628654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7201d533-66ee-42dd-b81c-f3f7474fe0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:06Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Creating volume 7201d533-66ee-42dd-b81c-f3f7474fe0e3 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:09 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df3784-f746-49f0-8d9d-b4cc857add3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:10 devstack sudo[103468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 1073741824
Jul 02 05:04:10 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6490d0b-b800-445f-a100-a7ebb152c7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:10 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Volume volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 (75c9f1d9-51f3-4f1b-beed-5b39b5049da7): created successfully
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6490d0b-b800-445f-a100-a7ebb152c7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (456a5ebf-4fd9-4615-ab18-219816746826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c83d0bc7-cd1d-4081-9619-a6966222fcef tempest-CreateVolumesFromImageTest-1739668065 None] Created volume successfully.
Jul 02 05:04:10 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 1073741824" returned: 0 in 0.797s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:10 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3
Jul 02 05:04:10 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:11 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3" returned: 0 in 0.626s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.565s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77359645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c65a187-33b3-4edb-8c39-9c25dd81a482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0793b0e316184a7a9e8f44fd81e6ff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:07Z,use_quota=True,user_id='933857dfad08453d84abad6517bb0e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Creating volume 2c65a187-33b3-4edb-8c39-9c25dd81a482 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:11 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3524451b-3d71-405c-90f7-27a949c01145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a64fbb-23cf-46fb-8302-1230f229c57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:11 devstack sudo[103477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 1073741824
Jul 02 05:04:11 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:11 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Volume volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 (7201d533-66ee-42dd-b81c-f3f7474fe0e3): created successfully
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a64fbb-23cf-46fb-8302-1230f229c57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:11 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (fda75297-7ee3-4bdc-8caf-bbccc35c18b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:11 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3af3d11c-9046-4dd7-bc80-0729e84c8aca tempest-CreateVolumesFromImageTest-1739668065 None] Created volume successfully.
Jul 02 05:04:12 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 1073741824" returned: 0 in 0.816s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:12 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482
Jul 02 05:04:12 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:12 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482" returned: 0 in 0.625s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4795844b-5078-44ba-9677-c50e7f66b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c65a187-33b3-4edb-8c39-9c25dd81a482', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e4b2c5-f89c-46c2-998f-38876a80d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:12 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Volume volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 (2c65a187-33b3-4edb-8c39-9c25dd81a482): created successfully
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e4b2c5-f89c-46c2-998f-38876a80d79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Flow 'volume_create_manager' (4d82f5f8-2435-495d-8f0b-02ed82be8f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f0e61c1d-59a3-4614-b9f3-fa317979fed6 tempest-CreateVolumesFromImageTest-1739668065 None] Created volume successfully.
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-2c65a187-33b3-4edb-8c39-9c25dd81a482-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-2c65a187-33b3-4edb-8c39-9c25dd81a482-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-quobyte-2c65a187-33b3-4edb-8c39-9c25dd81a482" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-2c65a187-33b3-4edb-8c39-9c25dd81a482" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a037a4-7931-468d-bf2c-3eaefc68444f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:13 devstack sudo[103485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482
Jul 02 05:04:13 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:14 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482" returned: 0 in 0.740s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:14 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482
Jul 02 05:04:14 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:14 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-2c65a187-33b3-4edb-8c39-9c25dd81a482" returned: 0 in 0.638s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-2c65a187-33b3-4edb-8c39-9c25dd81a482" released by "delete_volume" :: held 1.416s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Created reservations ['a51f4a34-6136-45e9-ab59-a9416ef02647', '69830960-74e6-4909-ad7e-ea25c3146732', '2ebf8777-d53f-46cb-ab26-2fddbab866f7', '8cc672ec-b7c3-4c5b-a670-91ad08c5ded4'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:15 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:15 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-7201d533-66ee-42dd-b81c-f3f7474fe0e3-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:15 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.648s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-7201d533-66ee-42dd-b81c-f3f7474fe0e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:15 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Deleted volume successfully.
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-be8e5e31-25c6-4629-a79b-ea9085fd307e tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-2c65a187-33b3-4edb-8c39-9c25dd81a482-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-quobyte-7201d533-66ee-42dd-b81c-f3f7474fe0e3" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-7201d533-66ee-42dd-b81c-f3f7474fe0e3" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de49e84-aac9-44a7-8b59-531dce8c5d9b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:15 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3
Jul 02 05:04:15 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:16 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3" returned: 0 in 0.737s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:16 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3
Jul 02 05:04:16 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:17 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7201d533-66ee-42dd-b81c-f3f7474fe0e3" returned: 0 in 0.661s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-7201d533-66ee-42dd-b81c-f3f7474fe0e3" released by "delete_volume" :: held 1.437s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Created reservations ['51dfcacd-1093-418e-bcfe-dffe3c74aa74', 'ac8e2286-4d50-4c62-bb4a-6ebeffeb9ce7', '8a12c5aa-2c94-4b40-8755-321594bea539', 'd74f9787-3c41-4f98-baba-58d1e008b691'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:17 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:17 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-75c9f1d9-51f3-4f1b-beed-5b39b5049da7-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-75c9f1d9-51f3-4f1b-beed-5b39b5049da7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-quobyte-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:17 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.647s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:17 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Deleted volume successfully.
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e0aca3cc-91f5-4eb5-833a-a94d3022cf5b tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-7201d533-66ee-42dd-b81c-f3f7474fe0e3-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd16ca33-663a-482c-80d1-bdadbb0e6ffd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:18 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7
Jul 02 05:04:18 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:18 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" returned: 0 in 0.755s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:18 devstack sudo[103513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7
Jul 02 05:04:18 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:19 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-75c9f1d9-51f3-4f1b-beed-5b39b5049da7" released by "delete_volume" :: held 1.442s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Created reservations ['59d39715-1d56-4262-bf4f-43807f24c161', '0c2aa13b-e07c-47cc-9534-61016b3bc7aa', '086ad796-6e92-4563-8e34-8859aba859ba', '4f9b9cf5-736a-4156-9399-b9947b847c37'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:19 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:19 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-841ecad6-b499-420f-a02a-31845642ace5-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-841ecad6-b499-420f-a02a-31845642ace5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:20 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.644s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:20 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Deleted volume successfully.
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-quobyte-841ecad6-b499-420f-a02a-31845642ace5" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-841ecad6-b499-420f-a02a-31845642ace5" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3c8eb3af-b2a3-4216-bfc6-93ca0a3ae920 tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-75c9f1d9-51f3-4f1b-beed-5b39b5049da7-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee9252-df77-4269-9201-317921a4bf82]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:20 devstack sudo[103521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5
Jul 02 05:04:20 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:20 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5" returned: 0 in 0.748s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:20 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5
Jul 02 05:04:20 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:21 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-841ecad6-b499-420f-a02a-31845642ace5" returned: 0 in 0.645s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-841ecad6-b499-420f-a02a-31845642ace5" released by "delete_volume" :: held 1.436s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Created reservations ['965c906b-84d0-4ead-83c4-3a1a54fffbdf', '499c31c1-7b86-4fb0-a294-48af0ce74cf9', '60b271fa-9b6c-42ee-8228-87f4db58a1bd', '5a08f3a9-7893-4533-8312-ef9eeb9fc27e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:21 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:21 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-a4e72d82-2cd5-483f-b06f-15ef19431e07-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-a4e72d82-2cd5-483f-b06f-15ef19431e07-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:22 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.662s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Deleted volume successfully.
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "cinder-quobyte-a4e72d82-2cd5-483f-b06f-15ef19431e07" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b4ef3079-49e1-4b3c-baf5-7ee9ab14a2df tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-841ecad6-b499-420f-a02a-31845642ace5-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-a4e72d82-2cd5-483f-b06f-15ef19431e07" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c594b482-bc1c-411a-833d-bf7d728b4a1c]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:22 devstack sudo[103533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07
Jul 02 05:04:22 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:23 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:23 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07
Jul 02 05:04:23 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:23 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a4e72d82-2cd5-483f-b06f-15ef19431e07" returned: 0 in 0.651s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-quobyte-a4e72d82-2cd5-483f-b06f-15ef19431e07" released by "delete_volume" :: held 1.415s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Created reservations ['5cad4bec-ec7c-41a6-9396-3bc6bc21cd0b', '57717050-142e-41e0-b31d-41951704e2f3', 'afbd76f3-83cf-49a7-af07-f6720717a0ec', '3dd1ae47-f2d0-463b-aa3e-65c178233652'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:23 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:23 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:24 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.660s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:24 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Deleted volume successfully.
Jul 02 05:04:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-2884102f-08c4-439b-83d3-88f112cf29ec tempest-CreateVolumesFromImageTest-1739668065 None] Lock "cinder-a4e72d82-2cd5-483f-b06f-15ef19431e07-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (2f28d0af-f44d-4483-a047-0d79720cea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b432fac-5b8a-4564-ad34-8e522c91d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b432fac-5b8a-4564-ad34-8e522c91d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521498788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee89024b-f077-483c-be9c-c04e53080000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:27Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9c5e03-fe21-4dcb-8327-2914f159e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9c5e03-fe21-4dcb-8327-2914f159e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0f29e6-034a-4072-9364-c5c72c6c3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0f29e6-034a-4072-9364-c5c72c6c3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee89024b-f077-483c-be9c-c04e53080000', 'volume_name': 'volume-ee89024b-f077-483c-be9c-c04e53080000', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef69fe4-042f-4011-a273-8a7beba87305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef69fe4-042f-4011-a273-8a7beba87305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6511c38a-5ff4-44a7-9b88-c0fcb19122b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:27 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume ee89024b-f077-483c-be9c-c04e53080000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee89024b-f077-483c-be9c-c04e53080000', 'volume_size': 1}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521498788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee89024b-f077-483c-be9c-c04e53080000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:27Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume ee89024b-f077-483c-be9c-c04e53080000 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:27 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:27 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 1073741824
Jul 02 05:04:27 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:27 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 1073741824" returned: 0 in 0.824s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:28 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000
Jul 02 05:04:28 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:28 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6511c38a-5ff4-44a7-9b88-c0fcb19122b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee89024b-f077-483c-be9c-c04e53080000', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa0861c-6ab8-44a4-9414-790dca3ff3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:28 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-ee89024b-f077-483c-be9c-c04e53080000 (ee89024b-f077-483c-be9c-c04e53080000): created successfully
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa0861c-6ab8-44a4-9414-790dca3ff3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (2f28d0af-f44d-4483-a047-0d79720cea52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c096ab9f-8a00-4af5-968a-7ac791158600 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (f3c7e1c3-f9fb-422f-b2be-7a26def82bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bac1506-05f3-4255-9125-74d5c4f1c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bac1506-05f3-4255-9125-74d5c4f1c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1215009576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41664f2-32e0-4923-a1e7-5796869f266a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e7de03-fac7-452d-b3d2-4bfc32c5dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e7de03-fac7-452d-b3d2-4bfc32c5dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66d89d-08e1-4b7c-9000-6166346e5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66d89d-08e1-4b7c-9000-6166346e5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41664f2-32e0-4923-a1e7-5796869f266a', 'volume_name': 'volume-a41664f2-32e0-4923-a1e7-5796869f266a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fef9cd-58f9-4f3a-97f2-30b44e91be77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fef9cd-58f9-4f3a-97f2-30b44e91be77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1749de9c-2bf2-4506-b2dd-bd4fc48c247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume a41664f2-32e0-4923-a1e7-5796869f266a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41664f2-32e0-4923-a1e7-5796869f266a', 'volume_size': 1}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1215009576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41664f2-32e0-4923-a1e7-5796869f266a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume a41664f2-32e0-4923-a1e7-5796869f266a {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:29 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:29 devstack sudo[103553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a 1073741824
Jul 02 05:04:29 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (875e43eb-35c6-402d-b8fd-236d15631080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3436bb37-0e9a-4919-8afc-64578cb62c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3436bb37-0e9a-4919-8afc-64578cb62c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781345212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b551758-572e-4955-955e-83694c292cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b551758-572e-4955-955e-83694c292cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c5fcd4-8501-4ede-9e48-7ff4a16a02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c5fcd4-8501-4ede-9e48-7ff4a16a02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7', 'volume_name': 'volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defdba33-f1d2-4656-a49f-c5f6654f557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defdba33-f1d2-4656-a49f-c5f6654f557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ae3905-51ec-4fca-ad1e-fe83d4801cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume 497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7', 'volume_size': 1}
Jul 02 05:04:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (b97564a6-a3d0-42ea-88fe-fe93d8fa3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5af1962-87b5-407b-8ef1-5c8f1fd1b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5af1962-87b5-407b-8ef1-5c8f1fd1b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194963450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd9f21-041e-4c65-af58-1d5c89d179a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b2253b-4275-477c-8f1c-4033a42b64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b2253b-4275-477c-8f1c-4033a42b64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa9395-0db1-4abb-9fc4-9d26a6fd5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa9395-0db1-4abb-9fc4-9d26a6fd5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dd9f21-041e-4c65-af58-1d5c89d179a6', 'volume_name': 'volume-36dd9f21-041e-4c65-af58-1d5c89d179a6', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dcdcc-35b3-4d2c-b554-e3e5dc7f905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dcdcc-35b3-4d2c-b554-e3e5dc7f905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292e487a-e1cd-4929-bab6-c0a2a44d7a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume 36dd9f21-041e-4c65-af58-1d5c89d179a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dd9f21-041e-4c65-af58-1d5c89d179a6', 'volume_size': 1}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:30 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (d58818cb-2ffd-4546-ab66-cf42372a3d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9181db7-27f6-4d35-ae53-42d181e6ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a 1073741824" returned: 0 in 0.970s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9181db7-27f6-4d35-ae53-42d181e6ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541878945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60faffcc-7cb8-4e27-a76f-1970863bba56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:31Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7ba90-414e-4b51-ac7c-873cf8e8badd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7ba90-414e-4b51-ac7c-873cf8e8badd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea8716b-f98d-4fed-9d8a-987e80a77fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea8716b-f98d-4fed-9d8a-987e80a77fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60faffcc-7cb8-4e27-a76f-1970863bba56', 'volume_name': 'volume-60faffcc-7cb8-4e27-a76f-1970863bba56', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503ac8d-c1a4-429e-95dd-a004d41b6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1503ac8d-c1a4-429e-95dd-a004d41b6f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb5176b-a09f-4c70-87bd-a3e0355d6f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume 60faffcc-7cb8-4e27-a76f-1970863bba56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60faffcc-7cb8-4e27-a76f-1970863bba56', 'volume_size': 1}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:30 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a
Jul 02 05:04:30 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (1859e77d-8da6-40bf-a2a9-32d33d48d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211a507-2b7a-4f7d-abee-5709ec61acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3211a507-2b7a-4f7d-abee-5709ec61acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648170735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbebd89d-d9ef-4734-b5fb-46a56134c922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:31Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5803c3dc-6a51-4aba-a8dd-32996008d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5803c3dc-6a51-4aba-a8dd-32996008d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84db0253-fd52-4e79-85c1-14788396f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84db0253-fd52-4e79-85c1-14788396f75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbebd89d-d9ef-4734-b5fb-46a56134c922', 'volume_name': 'volume-cbebd89d-d9ef-4734-b5fb-46a56134c922', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b7c82a-c2dd-46a3-bd89-0782e8ffccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b7c82a-c2dd-46a3-bd89-0782e8ffccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ccbaff-783b-4c6c-b7db-c2b2cf4790c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume cbebd89d-d9ef-4734-b5fb-46a56134c922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbebd89d-d9ef-4734-b5fb-46a56134c922', 'volume_size': 1}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:31 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a" returned: 0 in 0.649s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781345212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume 497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:31 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1749de9c-2bf2-4506-b2dd-bd4fc48c247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41664f2-32e0-4923-a1e7-5796869f266a', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab1d3fd-422e-4cb2-81fc-c3fe6c1cb76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:31 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 1073741824
Jul 02 05:04:31 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-a41664f2-32e0-4923-a1e7-5796869f266a (a41664f2-32e0-4923-a1e7-5796869f266a): created successfully
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab1d3fd-422e-4cb2-81fc-c3fe6c1cb76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (f3c7e1c3-f9fb-422f-b2be-7a26def82bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8cb90c57-a832-4335-9606-45190d76662e tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:32 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 1073741824" returned: 0 in 0.819s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:32 devstack sudo[103569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7
Jul 02 05:04:32 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:32 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" returned: 0 in 0.633s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194963450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dd9f21-041e-4c65-af58-1d5c89d179a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:30Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume 36dd9f21-041e-4c65-af58-1d5c89d179a6 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:32 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:32 devstack sudo[103572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 1073741824
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ae3905-51ec-4fca-ad1e-fe83d4801cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:32 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa69a1-6c59-45c6-aadc-39ac2f607099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 (497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7): created successfully
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa69a1-6c59-45c6-aadc-39ac2f607099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (875e43eb-35c6-402d-b8fd-236d15631080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-94546882-4323-4304-af1c-7278fb7e446d tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:33 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 1073741824" returned: 0 in 0.826s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:33 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6
Jul 02 05:04:33 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:34 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6" returned: 0 in 0.647s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541878945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60faffcc-7cb8-4e27-a76f-1970863bba56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:31Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume 60faffcc-7cb8-4e27-a76f-1970863bba56 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:34 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292e487a-e1cd-4929-bab6-c0a2a44d7a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dd9f21-041e-4c65-af58-1d5c89d179a6', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6d6417-0476-4dc4-8af9-d3ba7d82e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:34 devstack sudo[103580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 1073741824
Jul 02 05:04:34 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 (36dd9f21-041e-4c65-af58-1d5c89d179a6): created successfully
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6d6417-0476-4dc4-8af9-d3ba7d82e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (b97564a6-a3d0-42ea-88fe-fe93d8fa3bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-861012f2-d953-4797-a8f6-72c166b74e6f tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:35 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 1073741824" returned: 0 in 0.817s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:35 devstack sudo[103586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56
Jul 02 05:04:35 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:35 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56" returned: 0 in 0.623s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.856s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648170735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbebd89d-d9ef-4734-b5fb-46a56134c922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86c9d2dc0864a799b9ee8757fe84130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:31Z,use_quota=True,user_id='304785f26d404b33890c19cda625298c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Creating volume cbebd89d-d9ef-4734-b5fb-46a56134c922 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:35 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:35 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 1073741824
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb5176b-a09f-4c70-87bd-a3e0355d6f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60faffcc-7cb8-4e27-a76f-1970863bba56', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:35 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7341d3-e6d6-48b1-ae84-0f103f46d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-60faffcc-7cb8-4e27-a76f-1970863bba56 (60faffcc-7cb8-4e27-a76f-1970863bba56): created successfully
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7341d3-e6d6-48b1-ae84-0f103f46d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (d58818cb-2ffd-4546-ab66-cf42372a3d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3a6d3fb0-2a06-4e96-8da3-780ecbedfe5c tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:36 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 1073741824" returned: 0 in 0.816s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:36 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922
Jul 02 05:04:36 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:37 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922" returned: 0 in 0.636s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ccbaff-783b-4c6c-b7db-c2b2cf4790c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbebd89d-d9ef-4734-b5fb-46a56134c922', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167209a-c6f6-4ab9-8969-bbab67c4f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Volume volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 (cbebd89d-d9ef-4734-b5fb-46a56134c922): created successfully
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167209a-c6f6-4ab9-8969-bbab67c4f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Flow 'volume_create_manager' (1859e77d-8da6-40bf-a2a9-32d33d48d04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d563f469-2117-4381-b080-35bc2f1ae7e1 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created volume successfully.
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-cbebd89d-d9ef-4734-b5fb-46a56134c922-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-cbebd89d-d9ef-4734-b5fb-46a56134c922-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-cbebd89d-d9ef-4734-b5fb-46a56134c922" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-cbebd89d-d9ef-4734-b5fb-46a56134c922" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e38b9f-74fd-4d2b-bd71-5790a1f8afd7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:38 devstack sudo[103598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922
Jul 02 05:04:38 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:39 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922" returned: 0 in 0.753s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:39 devstack sudo[103605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922
Jul 02 05:04:39 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:40 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cbebd89d-d9ef-4734-b5fb-46a56134c922" returned: 0 in 0.636s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-cbebd89d-d9ef-4734-b5fb-46a56134c922" released by "delete_volume" :: held 1.427s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['bd392df6-0d92-4757-9c1e-7a35d14f092e', '9add85d1-bf4a-4bd8-a369-c9edd4a1e8ac', 'f625d481-0e30-491e-941c-537585e5727b', 'ff23be57-1a07-4e5c-8553-16fd972f9990'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:40 devstack sudo[103608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:40 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-60faffcc-7cb8-4e27-a76f-1970863bba56-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-60faffcc-7cb8-4e27-a76f-1970863bba56-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:40 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.658s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-60faffcc-7cb8-4e27-a76f-1970863bba56" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fe06e1eb-7e94-4a3f-bbac-763ae152c403 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-cbebd89d-d9ef-4734-b5fb-46a56134c922-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-60faffcc-7cb8-4e27-a76f-1970863bba56" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff08c7-9a3e-48ae-8fa8-b624d9a751a7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:40 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56
Jul 02 05:04:40 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:41 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:41 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56
Jul 02 05:04:41 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:42 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-60faffcc-7cb8-4e27-a76f-1970863bba56" returned: 0 in 0.630s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-60faffcc-7cb8-4e27-a76f-1970863bba56" released by "delete_volume" :: held 1.393s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['fa96db53-7e44-413b-8d63-652bd8985cd6', 'aef14a57-59c7-443a-91d0-e8339ce0cbde', '5077a653-959d-4d4d-8633-522fe8d22a66', 'c8929f48-b5e2-4706-98aa-872055cc0d21'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=65,cinder:UPDATE=107,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:42 devstack sudo[103620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:42 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:42 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-36dd9f21-041e-4c65-af58-1d5c89d179a6-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.644s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:43 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-36dd9f21-041e-4c65-af58-1d5c89d179a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7b7fe6dc-c29a-417e-9fcf-2267644ac6af tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-60faffcc-7cb8-4e27-a76f-1970863bba56-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-36dd9f21-041e-4c65-af58-1d5c89d179a6" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-36dd9f21-041e-4c65-af58-1d5c89d179a6" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[14421b67-9188-45d7-94b5-fe818a306a75]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:43 devstack sudo[103623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6
Jul 02 05:04:43 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:43 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:43 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6
Jul 02 05:04:43 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:44 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-36dd9f21-041e-4c65-af58-1d5c89d179a6" returned: 0 in 0.620s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-36dd9f21-041e-4c65-af58-1d5c89d179a6" released by "delete_volume" :: held 1.391s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['ad6c4cb6-a1ca-42a6-a898-dc3752332c22', 'c84f24fb-bfc6-4962-a78b-82e5f8d31622', 'e6aa0af4-dc52-4fc9-a411-043003156f15', '3bdd46ec-3d56-47a0-80b9-e83f0020083e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:44 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:44 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:45 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.622s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-7ee40c6c-49f3-4183-b115-4f92c2f2d5f6 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-36dd9f21-041e-4c65-af58-1d5c89d179a6-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d9a4d-df92-4909-a8ce-f19be944361b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:45 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7
Jul 02 05:04:45 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:46 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:46 devstack sudo[103639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7
Jul 02 05:04:46 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:46 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" returned: 0 in 0.657s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7" released by "delete_volume" :: held 1.425s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['a5c78535-b553-4639-86f5-b11f250c5521', 'cd9829e2-f6f6-47ec-8e6c-935d0b8f5e9d', '9e026b4e-a385-4920-997e-5556f4ef71a9', 'ec397654-e7d4-42e3-945d-338b533d638f'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:46 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:46 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-a41664f2-32e0-4923-a1e7-5796869f266a-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-a41664f2-32e0-4923-a1e7-5796869f266a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:47 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.655s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:47 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-a41664f2-32e0-4923-a1e7-5796869f266a" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-523b5abe-3305-4220-99ba-040164e42deb tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-497b8c1c-9c2f-4f54-8eea-c6e5027ee8b7-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-a41664f2-32e0-4923-a1e7-5796869f266a" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8c181-5adb-42b0-82a6-2636f30c35cb]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:47 devstack sudo[103645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a
Jul 02 05:04:47 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:48 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a" returned: 0 in 0.745s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:48 devstack sudo[103656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a
Jul 02 05:04:48 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:48 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a41664f2-32e0-4923-a1e7-5796869f266a" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-a41664f2-32e0-4923-a1e7-5796869f266a" released by "delete_volume" :: held 1.422s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['510f067f-f6cc-4610-801b-86b782af26b4', '80e9d4ed-ec76-4815-851f-24346cec1ae2', '8520193a-cf07-431f-a94b-85faf3785818', 'f130aef1-38b0-4d0f-a78c-c0942c351d41'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:49 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:49 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-ee89024b-f077-483c-be9c-c04e53080000-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-ee89024b-f077-483c-be9c-c04e53080000-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "cinder-quobyte-ee89024b-f077-483c-be9c-c04e53080000" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-ee89024b-f077-483c-be9c-c04e53080000" acquired by "delete_volume" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:04:49 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.686s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc6820-6f22-46e8-854d-cdd9ee25f882]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-aaecaba8-ce74-4cb5-9a7d-6ca6fa503e2b tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-a41664f2-32e0-4923-a1e7-5796869f266a-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:49 devstack sudo[103698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000
Jul 02 05:04:49 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:50 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000" returned: 0 in 0.740s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:50 devstack sudo[103703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000
Jul 02 05:04:50 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:51 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-ee89024b-f077-483c-be9c-c04e53080000" returned: 0 in 0.633s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-quobyte-ee89024b-f077-483c-be9c-c04e53080000" released by "delete_volume" :: held 1.417s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Created reservations ['55b2550f-7c0f-4d00-b108-667256c1ffc1', '34984577-aa32-4194-93f1-c08f21a3dca3', 'd779e399-e73e-4b18-ba90-493601edc93c', '2c5f85ba-f21a-47cc-aa42-90e584b2b32b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:51 devstack sudo[103707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:51 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:51 devstack sudo[103710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:04:51 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:51 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.634s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:51 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Deleted volume successfully.
Jul 02 05:04:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-46563ef9-1a8c-4621-8781-3e2dfb43c358 tempest-CreateVolumesFromSourceVolumeTest-642294858 None] Lock "cinder-ee89024b-f077-483c-be9c-c04e53080000-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:04:52 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.685s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:04:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:04:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:04:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Flow 'volume_create_manager' (fe6bc27c-0966-4f5e-958e-7c8e05f4b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5025e-2e41-442a-b2b7-56a0259e2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5025e-2e41-442a-b2b7-56a0259e2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02594dd-9465-47a2-b117-21acf75bbf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49fd16feb2422188e388ca0b0ece5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:54Z,use_quota=True,user_id='a59b4ced9db84defb53810e897585a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7746d3b5-d7d1-4e24-928f-eb7ce6ba1713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7746d3b5-d7d1-4e24-928f-eb7ce6ba1713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78179d93-7ba1-4c71-b409-20e981c1e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78179d93-7ba1-4c71-b409-20e981c1e366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02594dd-9465-47a2-b117-21acf75bbf27', 'volume_name': 'volume-f02594dd-9465-47a2-b117-21acf75bbf27', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1bd4f6-b5c2-4a2c-a04a-fc1bc4a177d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1bd4f6-b5c2-4a2c-a04a-fc1bc4a177d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941c6d65-b6fe-4a53-b239-22e552af705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Volume f02594dd-9465-47a2-b117-21acf75bbf27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02594dd-9465-47a2-b117-21acf75bbf27', 'volume_size': 1}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02594dd-9465-47a2-b117-21acf75bbf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49fd16feb2422188e388ca0b0ece5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:54Z,use_quota=True,user_id='a59b4ced9db84defb53810e897585a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Creating volume f02594dd-9465-47a2-b117-21acf75bbf27 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:54 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:54 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 1073741824
Jul 02 05:04:54 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:55 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 1073741824" returned: 0 in 0.806s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:55 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27
Jul 02 05:04:55 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:56 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27" returned: 0 in 0.640s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941c6d65-b6fe-4a53-b239-22e552af705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02594dd-9465-47a2-b117-21acf75bbf27', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8168eae-379d-4ed2-82f6-21f17f874c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Volume volume-f02594dd-9465-47a2-b117-21acf75bbf27 (f02594dd-9465-47a2-b117-21acf75bbf27): created successfully
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8168eae-379d-4ed2-82f6-21f17f874c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Flow 'volume_create_manager' (fe6bc27c-0966-4f5e-958e-7c8e05f4b779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1c42cd1d-979b-4d32-8fd7-0d3c432f37db tempest-CinderUnicodeTest-505462544 None] Created volume successfully.
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Flow 'volume_create_manager' (5184e901-ad59-4677-bcea-e0f8c8eaba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45adfc88-3d24-48fc-a2bf-bfba6a3add2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45adfc88-3d24-48fc-a2bf-bfba6a3add2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1940943160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a76af4-be39-44a6-a619-89d75e2585f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49fd16feb2422188e388ca0b0ece5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:57Z,use_quota=True,user_id='a59b4ced9db84defb53810e897585a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bef39c-18bf-4b83-8b09-fd52c3d7862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bef39c-18bf-4b83-8b09-fd52c3d7862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13340226-073f-4ee4-868a-b55e451adecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13340226-073f-4ee4-868a-b55e451adecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a76af4-be39-44a6-a619-89d75e2585f3', 'volume_name': 'volume-04a76af4-be39-44a6-a619-89d75e2585f3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220b2bb2-b270-4ca6-9399-cf561b222a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220b2bb2-b270-4ca6-9399-cf561b222a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb872876-3876-4cb8-a655-72a2b286261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:57 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Volume 04a76af4-be39-44a6-a619-89d75e2585f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a76af4-be39-44a6-a619-89d75e2585f3', 'volume_size': 1}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:04:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1940943160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a76af4-be39-44a6-a619-89d75e2585f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee49fd16feb2422188e388ca0b0ece5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:04:57Z,use_quota=True,user_id='a59b4ced9db84defb53810e897585a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Creating volume 04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:04:57 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:57 devstack sudo[103722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 1073741824
Jul 02 05:04:57 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:57 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 1073741824" returned: 0 in 0.791s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:57 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3
Jul 02 05:04:57 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:04:58 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3" returned: 0 in 0.623s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb872876-3876-4cb8-a655-72a2b286261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a76af4-be39-44a6-a619-89d75e2585f3', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918d0187-9812-4fed-80f8-b347ddc07fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:04:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Volume volume-04a76af4-be39-44a6-a619-89d75e2585f3 (04a76af4-be39-44a6-a619-89d75e2585f3): created successfully
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918d0187-9812-4fed-80f8-b347ddc07fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:04:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Flow 'volume_create_manager' (5184e901-ad59-4677-bcea-e0f8c8eaba9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:04:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-647ae652-c969-4fcd-9441-e076db064f5f tempest-CinderUnicodeTest-505462544 None] Created volume successfully.
Jul 02 05:04:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:04:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:04:59 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Creating offline snapshot 8e82007b-5a4d-49ac-b918-b6ea7277b248 of volume 04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:04:59 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac9c70-b7ff-450c-97ce-0305aeedb7f7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:04:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:04:59 devstack sudo[103731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3
Jul 02 05:04:59 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:00 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:00 devstack sudo[103736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 1G
Jul 02 05:05:00 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:00 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 1G" returned: 0 in 0.750s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a76af4-be39-44a6-a619-89d75e2585f3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:00 devstack sudo[103741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a76af4-be39-44a6-a619-89d75e2585f3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248
Jul 02 05:05:00 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:01 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a76af4-be39-44a6-a619-89d75e2585f3 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248" returned: 0 in 0.688s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:01 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 is being set with open permissions: ugo+rw
Jul 02 05:05:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:01 devstack sudo[103747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248
Jul 02 05:05:01 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:02 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248" returned: 0 in 0.614s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:02 devstack sudo[103753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info
Jul 02 05:05:02 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:02 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info" returned: 0 in 0.637s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:02 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info is being set with open permissions: ugo+rw
Jul 02 05:05:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:02 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info
Jul 02 05:05:02 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:03 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.info" returned: 0 in 0.641s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-30487893-d559-4b91-bf24-8a3935eb8877 tempest-CinderUnicodeTest-505462544 None] Create snapshot completed successfully
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-8e82007b-5a4d-49ac-b918-b6ea7277b248-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-8e82007b-5a4d-49ac-b918-b6ea7277b248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-quobyte-8e82007b-5a4d-49ac-b918-b6ea7277b248" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-8e82007b-5a4d-49ac-b918-b6ea7277b248" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Deleting offline snapshot 8e82007b-5a4d-49ac-b918-b6ea7277b248 of volume 04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] snapshot_file for this snap is: volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d87fa-55b4-4e42-b9fb-27bc6d9cf1fa]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:04 devstack sudo[103759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248
Jul 02 05:05:04 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:05 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a76af4-be39-44a6-a619-89d75e2585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:05:05 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0156f0-eb39-4d4c-9ccd-3180fbe94f39]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:05 devstack sudo[103764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3
Jul 02 05:05:05 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:06 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3" returned: 0 in 0.741s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:06 devstack sudo[103769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248
Jul 02 05:05:06 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:06 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248" returned: 0 in 0.703s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:06 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248
Jul 02 05:05:06 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:07 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3.8e82007b-5a4d-49ac-b918-b6ea7277b248" returned: 0 in 0.622s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-8e82007b-5a4d-49ac-b918-b6ea7277b248" released by "_delete_snapshot" :: held 2.897s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" released by "delete_snapshot" :: held 2.918s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Created reservations ['652f2d21-b21a-434f-b6c2-29dcd12f47dd', '05faf544-bca7-48b2-b73c-52f75f5c1846', '061acd6f-8801-4718-81f9-c0446991e254', '0c37d5df-9524-4aa3-a37f-76398dd763f1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Delete snapshot completed successfully.
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-354d43bb-08f6-4091-a9c0-9ba178ab79b4 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-8e82007b-5a4d-49ac-b918-b6ea7277b248-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-04a76af4-be39-44a6-a619-89d75e2585f3-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "cinder-04a76af4-be39-44a6-a619-89d75e2585f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" acquired by "delete_volume" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a0efd-f9da-4faf-bda8-f3de225351a8]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:07 devstack sudo[103777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3
Jul 02 05:05:07 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:08 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3" returned: 0 in 0.733s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:08 devstack sudo[103782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3
Jul 02 05:05:08 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:09 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-04a76af4-be39-44a6-a619-89d75e2585f3" returned: 0 in 0.626s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-04a76af4-be39-44a6-a619-89d75e2585f3" released by "delete_volume" :: held 1.412s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Created reservations ['21144679-3144-47e3-a93f-7ff44a44e726', '59de39fc-9959-49ab-bbd4-e05710bf14bb', '3c6c008e-a1c5-4ed1-ba84-72ca9dc40018', '163de64b-9ea9-4b50-8b2a-12ffcc2eb1b7'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:09 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:09 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-f02594dd-9465-47a2-b117-21acf75bbf27-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:09 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.654s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Deleted volume successfully.
Jul 02 05:05:09 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-f02594dd-9465-47a2-b117-21acf75bbf27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfeab8b8-489d-4111-9df8-72758e9cdc9d tempest-CinderUnicodeTest-505462544 None] Lock "cinder-04a76af4-be39-44a6-a619-89d75e2585f3-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "cinder-quobyte-f02594dd-9465-47a2-b117-21acf75bbf27" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-f02594dd-9465-47a2-b117-21acf75bbf27" acquired by "delete_volume" :: waited 0.013s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ff4d3-a999-4ae8-b144-3da94d30f76b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:10 devstack sudo[103788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27
Jul 02 05:05:10 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:10 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27" returned: 0 in 0.735s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:10 devstack sudo[103793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27
Jul 02 05:05:10 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:11 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f02594dd-9465-47a2-b117-21acf75bbf27" returned: 0 in 0.646s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-quobyte-f02594dd-9465-47a2-b117-21acf75bbf27" released by "delete_volume" :: held 1.421s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Created reservations ['fc2cdcf3-bc74-4fad-b45c-6d0db2a2f2f5', '4e34d89a-8ba9-4763-9515-7b1f8ee33fff', '5c3df894-8881-4347-bc5a-f460ff527686', 'd43b1862-af4d-4b22-890a-2dedf4e5572c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:11 devstack sudo[103797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:11 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:12 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.644s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:12 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Deleted volume successfully.
Jul 02 05:05:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-fcf29ae4-dda9-451f-bed6-1ce6e922c7d9 tempest-CinderUnicodeTest-505462544 None] Lock "cinder-f02594dd-9465-47a2-b117-21acf75bbf27-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:21 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:DELETE=5,cinder:SELECT=39,cinder:UPDATE=67,cinder:INSERT=12 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:05:22 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=46,cinder:INSERT=19,cinder:UPDATE=55,cinder:DELETE=5 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (e6dc1bd3-d7f3-45cf-a35e-05dc53f8aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca62b8a-9e84-4242-bced-02b0ac5f3638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca62b8a-9e84-4242-bced-02b0ac5f3638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733394514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516f886f-c68c-4b70-a5b2-9c3224ec5b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f20596-44ce-4f10-a470-298a7674ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f20596-44ce-4f10-a470-298a7674ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115c88a8-1a80-4515-b2f0-b80103892cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115c88a8-1a80-4515-b2f0-b80103892cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516f886f-c68c-4b70-a5b2-9c3224ec5b4c', 'volume_name': 'volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ef1859-2380-419d-a433-799440f440c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ef1859-2380-419d-a433-799440f440c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fa4be-1d0c-46e0-9a5d-569af10e3de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Volume 516f886f-c68c-4b70-a5b2-9c3224ec5b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c', 'volume_size': 1}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733394514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516f886f-c68c-4b70-a5b2-9c3224ec5b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Creating volume 516f886f-c68c-4b70-a5b2-9c3224ec5b4c {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:24 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:24 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c 1073741824
Jul 02 05:05:24 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Flow 'volume_create_manager' (eb43d12d-bb9a-4aaa-9f35-ad29af65326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91216a6-c3bf-4438-8ff6-adf545978024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91216a6-c3bf-4438-8ff6-adf545978024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549539827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db99823a-b99e-4a82-9287-e857aec89e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085e04694824f06a3768ccc845fdd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='620d4d43411c4df4889cffa838a18b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f02e124-2b15-44b4-a280-c74c814cb185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f02e124-2b15-44b4-a280-c74c814cb185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02402712-511e-4f46-839c-d4ff745b812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02402712-511e-4f46-839c-d4ff745b812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db99823a-b99e-4a82-9287-e857aec89e71', 'volume_name': 'volume-db99823a-b99e-4a82-9287-e857aec89e71', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf56709-a770-44c4-a72c-3b6284cbfbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf56709-a770-44c4-a72c-3b6284cbfbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592b285a-978e-41cb-ab17-4f2ffd8e9fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Volume db99823a-b99e-4a82-9287-e857aec89e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db99823a-b99e-4a82-9287-e857aec89e71', 'volume_size': 1}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (85e7844c-f72a-43cb-8364-e81ee6e03b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf645c-b59f-40c8-9d44-2bc9c6241f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf645c-b59f-40c8-9d44-2bc9c6241f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146466217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ba25f6-a7f1-4cdb-9196-38398b3b24e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76a3ec3-f078-4f34-a503-1c7dd052f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76a3ec3-f078-4f34-a503-1c7dd052f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c5382-33e3-4893-85a9-0e6cf8332b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c5382-33e3-4893-85a9-0e6cf8332b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ba25f6-a7f1-4cdb-9196-38398b3b24e5', 'volume_name': 'volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d361e228-b739-4c72-949b-cea18a89a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d361e228-b739-4c72-949b-cea18a89a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4c0eeb-4851-4630-bf54-90204ae2e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Volume 50ba25f6-a7f1-4cdb-9196-38398b3b24e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5', 'volume_size': 1}
Jul 02 05:05:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (d32333e9-3d9e-407d-8245-b8cc9dcb4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:25 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4fdd60-6c18-42a6-ab1b-93898b1be7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c 1073741824" returned: 0 in 1.333s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4fdd60-6c18-42a6-ab1b-93898b1be7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390606151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7551b0-1327-4cb7-b8c5-37f9af06da79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:25Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a2b55-7fe9-464a-bea5-fdb32b36f465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a2b55-7fe9-464a-bea5-fdb32b36f465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfbc502-e5fb-42bb-854d-0f4c537f01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfbc502-e5fb-42bb-854d-0f4c537f01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7551b0-1327-4cb7-b8c5-37f9af06da79', 'volume_name': 'volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e628fa-22a7-4ef1-a6b4-86f0ac92068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e628fa-22a7-4ef1-a6b4-86f0ac92068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e7515-2088-46b7-951e-63d946a8d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Volume 6c7551b0-1327-4cb7-b8c5-37f9af06da79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79', 'volume_size': 1}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:25 devstack sudo[103847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c
Jul 02 05:05:25 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (36358b43-05f4-411f-92a7-922499fdf73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe747b-9b7a-446d-81b7-2c2e9856ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe747b-9b7a-446d-81b7-2c2e9856ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2099159378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b459dc0f-3ca9-49f3-b519-1a8065366b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:26Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1702739e-939f-4d21-9d36-a37ed27cd0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1702739e-939f-4d21-9d36-a37ed27cd0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec31200e-9e3b-4341-8f76-9c0d165ccac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec31200e-9e3b-4341-8f76-9c0d165ccac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b459dc0f-3ca9-49f3-b519-1a8065366b44', 'volume_name': 'volume-b459dc0f-3ca9-49f3-b519-1a8065366b44', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62daa3fa-b20c-4429-bec2-8c9273bcab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62daa3fa-b20c-4429-bec2-8c9273bcab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090158d6-9a13-4c73-8d6f-c30fec4d7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Volume b459dc0f-3ca9-49f3-b519-1a8065366b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b459dc0f-3ca9-49f3-b519-1a8065366b44', 'volume_size': 1}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (121b2ce6-8944-4395-8f54-05d82f2532dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e617f-662a-4285-bd3c-fe5bdbfd9fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e617f-662a-4285-bd3c-fe5bdbfd9fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072165151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786b7ce3-babf-475f-87ba-63be600afc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:26Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c71b2b1-ffc8-4e17-a89b-669d5bcbccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c71b2b1-ffc8-4e17-a89b-669d5bcbccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e530a-9487-40a4-9dfa-e7644ef8ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e530a-9487-40a4-9dfa-e7644ef8ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786b7ce3-babf-475f-87ba-63be600afc9d', 'volume_name': 'volume-786b7ce3-babf-475f-87ba-63be600afc9d', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2610f4b-5d0d-4f80-afec-ccbeabb89006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2610f4b-5d0d-4f80-afec-ccbeabb89006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d93b9-296f-4542-bf85-11a7a30918d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Volume 786b7ce3-babf-475f-87ba-63be600afc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786b7ce3-babf-475f-87ba-63be600afc9d', 'volume_size': 1}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:26 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" returned: 0 in 0.975s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549539827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db99823a-b99e-4a82-9287-e857aec89e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085e04694824f06a3768ccc845fdd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='620d4d43411c4df4889cffa838a18b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Creating volume db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:26 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fa4be-1d0c-46e0-9a5d-569af10e3de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17e4099-2e7c-4468-bddc-219e42929767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:26 devstack sudo[103851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 1073741824
Jul 02 05:05:26 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Volume volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c (516f886f-c68c-4b70-a5b2-9c3224ec5b4c): created successfully
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17e4099-2e7c-4468-bddc-219e42929767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (e6dc1bd3-d7f3-45cf-a35e-05dc53f8aece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:26 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-73ac8c0d-90a0-466d-af93-4abeabae85f8 tempest-CreateVolumesFromImageTest-1852287208 None] Created volume successfully.
Jul 02 05:05:27 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 1073741824" returned: 0 in 0.937s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:27 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:05:27 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:28 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 0.735s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.693s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146466217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ba25f6-a7f1-4cdb-9196-38398b3b24e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:24Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Creating volume 50ba25f6-a7f1-4cdb-9196-38398b3b24e5 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:28 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592b285a-978e-41cb-ab17-4f2ffd8e9fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db99823a-b99e-4a82-9287-e857aec89e71', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:28 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 1073741824
Jul 02 05:05:28 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6e89da-c6e2-4bfb-af4e-550a11558a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:28 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Volume volume-db99823a-b99e-4a82-9287-e857aec89e71 (db99823a-b99e-4a82-9287-e857aec89e71): created successfully
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6e89da-c6e2-4bfb-af4e-550a11558a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Flow 'volume_create_manager' (eb43d12d-bb9a-4aaa-9f35-ad29af65326c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:28 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-f71f7bfd-a774-4310-b529-e89cce1346d6 tempest-VolumeDependencyTests-781908860 None] Created volume successfully.
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Flow 'volume_create_manager' (6ccf3b93-d789-4fe7-89a4-f5811678d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a6b45b-c6c0-4744-a938-c833c0db110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a6b45b-c6c0-4744-a938-c833c0db110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f336619-9a4b-4f15-9468-fe8cde744fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dbe718f19940548b30166f2cb41426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:29Z,use_quota=True,user_id='dc8c57b4850045328730b68007634fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d4f78a3-9eed-48c8-976d-80e06bdea063),volume_type_id=1d4f78a3-9eed-48c8-976d-80e06bdea063)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b899e-8eb3-4edd-857d-8e5459065351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b899e-8eb3-4edd-857d-8e5459065351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c00ca8-ae35-4f42-b762-ec3cde9b56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:28 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c00ca8-ae35-4f42-b762-ec3cde9b56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f336619-9a4b-4f15-9468-fe8cde744fe4', 'volume_name': 'volume-0f336619-9a4b-4f15-9468-fe8cde744fe4', 'volume_size': 1, 'image_id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1111d683a0d193f6df7a2883e4d880c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70dbe718f19940548b30166f2cb41426', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3563cc9b8a8c7a8efee296819eb834c639b5f612159e4961884201994682269a01cb9ed1b69eb3fc1460f9635ab53a249bb837762cd9f0cd1fbfa7eb5b2a80da', 'id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'created_at': datetime.datetime(2026, 7, 2, 3, 5, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 5, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a9f3036-7507-4d0a-b719-0b041b9ae682/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd6300>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f4555-1bb1-45d1-be20-94de802b8ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f4555-1bb1-45d1-be20-94de802b8ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0f6fa2-01fe-480d-aae9-eb1baa6d6a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:29 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Volume 0f336619-9a4b-4f15-9468-fe8cde744fe4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f336619-9a4b-4f15-9468-fe8cde744fe4', 'volume_size': 1, 'image_id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1111d683a0d193f6df7a2883e4d880c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70dbe718f19940548b30166f2cb41426', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3563cc9b8a8c7a8efee296819eb834c639b5f612159e4961884201994682269a01cb9ed1b69eb3fc1460f9635ab53a249bb837762cd9f0cd1fbfa7eb5b2a80da', 'id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'created_at': datetime.datetime(2026, 7, 2, 3, 5, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 5, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a9f3036-7507-4d0a-b719-0b041b9ae682/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd6300>}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Trying to clone 0f336619-9a4b-4f15-9468-fe8cde744fe4 from image 6a9f3036-7507-4d0a-b719-0b041b9ae682 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 05:05:29 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b41f0-09e6-4f53-ad95-64c17e5e575d]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:29 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 1073741824" returned: 0 in 0.988s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:29 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:29 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:29 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5
Jul 02 05:05:29 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:30 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 0 in 1.139s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:30 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" returned: 0 in 1.024s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.823s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390606151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7551b0-1327-4cb7-b8c5-37f9af06da79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:25Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Creating volume 6c7551b0-1327-4cb7-b8c5-37f9af06da79 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:30 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:30 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4c0eeb-4851-4630-bf54-90204ae2e85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:30 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:30 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 1073741824
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2941ac10-fe37-4e0e-910e-5244179e7361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:30 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Volume volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 (50ba25f6-a7f1-4cdb-9196-38398b3b24e5): created successfully
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2941ac10-fe37-4e0e-910e-5244179e7361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (85e7844c-f72a-43cb-8364-e81ee6e03b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:30 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8899c1b8-15a6-4d07-8d2b-e95bbb076888 tempest-CreateVolumesFromImageTest-1852287208 None] Created volume successfully.
Jul 02 05:05:31 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 1 in 0.882s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Temporary image 6a9f3036-7507-4d0a-b719-0b041b9ae682 is fetched for user dc8c57b4850045328730b68007634fc2. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f825673-a7ba-4cd3-a2ae-b5e5ebddf679]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:31 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 1073741824" returned: 0 in 1.006s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:31 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:31 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:31 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79
Jul 02 05:05:31 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:32 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:32 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79" returned: 0 in 0.735s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.217s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2099159378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b459dc0f-3ca9-49f3-b519-1a8065366b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:26Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Creating volume b459dc0f-3ca9-49f3-b519-1a8065366b44 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:32 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e7515-2088-46b7-951e-63d946a8d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:32 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:32 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82568730-cdff-4ccc-8512-a13184149649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:32 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 1073741824
Jul 02 05:05:32 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Volume volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 (6c7551b0-1327-4cb7-b8c5-37f9af06da79): created successfully
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82568730-cdff-4ccc-8512-a13184149649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (d32333e9-3d9e-407d-8245-b8cc9dcb4e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:32 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b2a14a28-f6db-4777-99ce-6bf9b7954a4f tempest-CreateVolumesFromImageTest-1852287208 None] Created volume successfully.
Jul 02 05:05:33 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 1 in 0.917s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:33 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 1073741824" returned: 0 in 0.985s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:33 devstack sudo[103903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44
Jul 02 05:05:33 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:33 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44" returned: 0 in 0.645s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.488s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2072165151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786b7ce3-babf-475f-87ba-63be600afc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6267e997b8472988907a61a281bda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:26Z,use_quota=True,user_id='ab13e296d6474ac09abbee6a6ac24b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Creating volume 786b7ce3-babf-475f-87ba-63be600afc9d {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:33 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:33 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d 1073741824
Jul 02 05:05:33 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090158d6-9a13-4c73-8d6f-c30fec4d7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b459dc0f-3ca9-49f3-b519-1a8065366b44', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e347d0fc-1a37-498d-9902-417c98aa4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:34 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Volume volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 (b459dc0f-3ca9-49f3-b519-1a8065366b44): created successfully
Jul 02 05:05:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e347d0fc-1a37-498d-9902-417c98aa4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:34 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (36358b43-05f4-411f-92a7-922499fdf73b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:34 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-8e0f5dec-5b87-4929-b360-eaf1dca3a10c tempest-CreateVolumesFromImageTest-1852287208 None] Created volume successfully.
Jul 02 05:05:35 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d 1073741824" returned: 0 in 1.105s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:35 devstack sudo[103912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d
Jul 02 05:05:35 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:35 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d" returned: 0 in 0.700s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.884s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Creating offline snapshot bd731118-9742-4233-9d4f-88926b8bc358 of volume db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d93b9-296f-4542-bf85-11a7a30918d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786b7ce3-babf-475f-87ba-63be600afc9d', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c20e0d1-d6ba-48cf-bdc9-4fd7e835bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[948839a2-097c-4763-aa58-d39d88a7eae1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Volume volume-786b7ce3-babf-475f-87ba-63be600afc9d (786b7ce3-babf-475f-87ba-63be600afc9d): created successfully
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c20e0d1-d6ba-48cf-bdc9-4fd7e835bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Flow 'volume_create_manager' (121b2ce6-8944-4395-8f54-05d82f2532dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4875656c-b38b-45e5-8f5c-9bd3e8e746dd tempest-CreateVolumesFromImageTest-1852287208 None] Created volume successfully.
Jul 02 05:05:35 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:05:35 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-786b7ce3-babf-475f-87ba-63be600afc9d-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-786b7ce3-babf-475f-87ba-63be600afc9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-quobyte-786b7ce3-babf-475f-87ba-63be600afc9d" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-786b7ce3-babf-475f-87ba-63be600afc9d" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa5e68-d281-4dd5-b32d-557b7df201ed]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:36 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 0.858s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:36 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d
Jul 02 05:05:36 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:36 devstack sudo[103921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 1G
Jul 02 05:05:36 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:37 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d" returned: 0 in 0.831s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:37 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d
Jul 02 05:05:37 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:37 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 1G" returned: 0 in 0.909s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db99823a-b99e-4a82-9287-e857aec89e71 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:37 devstack sudo[103934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db99823a-b99e-4a82-9287-e857aec89e71 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:37 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:38 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786b7ce3-babf-475f-87ba-63be600afc9d" returned: 0 in 0.640s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-786b7ce3-babf-475f-87ba-63be600afc9d" released by "delete_volume" :: held 1.525s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Created reservations ['4181371a-a7a2-4313-8378-4356ef8cd43a', '49e85caf-4522-4d10-ab7b-ac34020d105d', 'ef6f79e1-4449-47d5-b372-772a5e9a5ea2', '9c1b4044-6593-49a7-b7ba-a334d09d78e2'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:38 devstack sudo[103941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:38 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:38 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db99823a-b99e-4a82-9287-e857aec89e71 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:38 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 is being set with open permissions: ugo+rw
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:38 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:38 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-b459dc0f-3ca9-49f3-b519-1a8065366b44-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-b459dc0f-3ca9-49f3-b519-1a8065366b44-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-quobyte-b459dc0f-3ca9-49f3-b519-1a8065366b44" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-b459dc0f-3ca9-49f3-b519-1a8065366b44" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb64b0-1576-4682-b1e0-f0c6ad45057f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:38 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.725s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:38 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Deleted volume successfully.
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-ed76a216-4a90-465b-8903-9dfa6fe740a2 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-786b7ce3-babf-475f-87ba-63be600afc9d-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:39 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44
Jul 02 05:05:39 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:39 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 0.773s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:39 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info
Jul 02 05:05:39 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:39 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44" returned: 0 in 0.852s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:39 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:39 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:39 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info is being set with open permissions: ugo+rw
Jul 02 05:05:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:39 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:39 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info
Jul 02 05:05:39 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:40 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-b459dc0f-3ca9-49f3-b519-1a8065366b44" returned: 0 in 0.744s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-b459dc0f-3ca9-49f3-b519-1a8065366b44" released by "delete_volume" :: held 1.663s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:40 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.info" returned: 0 in 0.763s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.841s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.590s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f336619-9a4b-4f15-9468-fe8cde744fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dbe718f19940548b30166f2cb41426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:29Z,use_quota=True,user_id='dc8c57b4850045328730b68007634fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d4f78a3-9eed-48c8-976d-80e06bdea063),volume_type_id=1d4f78a3-9eed-48c8-976d-80e06bdea063)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Creating volume 0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:40 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:40 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1073741824
Jul 02 05:05:40 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ee49423a-1a06-476f-bdce-a46e5548516d tempest-VolumeDependencyTests-781908860 None] Create snapshot completed successfully
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Created reservations ['c5a1bb96-6a8b-4d18-84c9-b001540bb49a', 'dc118880-7afa-4084-9a72-527318240077', 'ed9c8bdc-fe74-435d-bd48-83365024dbeb', '78a21945-e908-4dc7-a0de-bc4bd1faeb78'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:40 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:40 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-6c7551b0-1327-4cb7-b8c5-37f9af06da79-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-6c7551b0-1327-4cb7-b8c5-37f9af06da79-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-quobyte-6c7551b0-1327-4cb7-b8c5-37f9af06da79" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-6c7551b0-1327-4cb7-b8c5-37f9af06da79" acquired by "delete_volume" :: waited 0.025s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f7e433-4db6-4e24-99d4-338860c7866d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:41 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79
Jul 02 05:05:41 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:41 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.084s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:41 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Deleted volume successfully.
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-99306122-3fb8-4bcf-bcb0-c2f189728972 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-b459dc0f-3ca9-49f3-b519-1a8065366b44-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:41 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1073741824" returned: 0 in 1.311s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:42 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:42 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Flow 'volume_create_manager' (50791034-93a5-4677-b98e-14c808f3f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c26714-5cd6-4623-b823-3bbbb9661992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c26714-5cd6-4623-b823-3bbbb9661992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-217074376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83598a6f-12d6-4d5f-8f23-78812f577842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085e04694824f06a3768ccc845fdd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd731118-9742-4233-9d4f-88926b8bc358,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:42Z,use_quota=True,user_id='620d4d43411c4df4889cffa838a18b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17ec472-8e25-4968-82b4-be8058567470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17ec472-8e25-4968-82b4-be8058567470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b77ecb-878f-491b-a6f3-55446e3664cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b77ecb-878f-491b-a6f3-55446e3664cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83598a6f-12d6-4d5f-8f23-78812f577842', 'volume_name': 'volume-83598a6f-12d6-4d5f-8f23-78812f577842', 'volume_size': 1, 'snapshot_id': 'bd731118-9742-4233-9d4f-88926b8bc358'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653dc39-88a2-45a2-9a70-567b02db6cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653dc39-88a2-45a2-9a70-567b02db6cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16253b36-374f-41e2-9fd2-e94e52be9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:42 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Volume 83598a6f-12d6-4d5f-8f23-78812f577842: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83598a6f-12d6-4d5f-8f23-78812f577842', 'volume_size': 1, 'snapshot_id': 'bd731118-9742-4233-9d4f-88926b8bc358'}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:42 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79" returned: 0 in 1.304s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:42 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79
Jul 02 05:05:42 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:43 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 0 in 1.007s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.384s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.631s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358-83598a6f-12d6-4d5f-8f23-78812f577842" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358-83598a6f-12d6-4d5f-8f23-78812f577842" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Creating volume 83598a6f-12d6-4d5f-8f23-78812f577842 from snapshot bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] snapshot: bd731118-9742-4233-9d4f-88926b8bc358, volume: 83598a6f-12d6-4d5f-8f23-78812f577842,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Attempting download of 6a9f3036-7507-4d0a-b719-0b041b9ae682 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}])) to volume 0f336619-9a4b-4f15-9468-fe8cde744fe4. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f90f4-6ab0-48bd-a9b0-c0739ba068ec]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0c18e-0bff-40db-b565-198ec7d37e59]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:43 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob
Jul 02 05:05:43 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:43 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:43 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:43 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-6c7551b0-1327-4cb7-b8c5-37f9af06da79" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-6c7551b0-1327-4cb7-b8c5-37f9af06da79" released by "delete_volume" :: held 2.268s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Created reservations ['849ca710-bda0-40a0-ad31-b1d962cf58d8', '43b12e80-7084-4963-8ad1-f9463203c61f', '83923954-6d09-48d1-99f6-d6de56d7dd04', '7dfa6b52-b18f-425e-9a74-8086d51f139d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:43 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:43 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:44 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob" returned: 0 in 1.111s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:44 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 1.317s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db99823a-b99e-4a82-9287-e857aec89e71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 05:05:44 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.866s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-50ba25f6-a7f1-4cdb-9196-38398b3b24e5-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c201981-7c4c-403a-9099-329762fb9d65]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:44 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Deleted volume successfully.
Jul 02 05:05:44 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob
Jul 02 05:05:44 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-50ba25f6-a7f1-4cdb-9196-38398b3b24e5-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-1705f981-5276-4de0-a571-92820cb782b4 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-6c7551b0-1327-4cb7-b8c5-37f9af06da79-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-quobyte-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:44 devstack sudo[103996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:05:44 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" acquired by "delete_volume" :: waited 0.035s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce8286-ee4d-4111-be09-188bddfef07d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:44 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5
Jul 02 05:05:44 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:45 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob" returned: 1 in 1.212s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a9f3036-7507-4d0a-b719-0b041b9ae682_8x9830ob' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba3134-8ff1-46bd-bbb2-374de9dc7811]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:45 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 0.995s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 05:05:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:45 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842
Jul 02 05:05:45 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:45 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:45 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:46 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" returned: 0 in 1.244s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:46 devstack sudo[104013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5
Jul 02 05:05:46 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:46 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 0 in 0.982s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:46 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD
Jul 02 05:05:46 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:47 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" returned: 0 in 1.090s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-50ba25f6-a7f1-4cdb-9196-38398b3b24e5" released by "delete_volume" :: held 2.400s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Created reservations ['df50844d-9216-4c86-baf6-30e82df91a36', 'cb400ff8-0219-40e6-8b64-bc6724f57080', '782e5cf4-ccf5-4d0f-ad8d-20cec5396767', '40016c61-77f7-4f17-bd3c-76c59af90a93'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:47 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD" returned: 1 in 1.069s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] 6a9f3036-7507-4d0a-b719-0b041b9ae682 was raw, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 05:05:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:47 devstack sudo[104033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:47 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:47 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:47 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-516f886f-c68c-4b70-a5b2-9c3224ec5b4c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-516f886f-c68c-4b70-a5b2-9c3224ec5b4c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "cinder-quobyte-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" acquired by "delete_volume" :: waited 0.087s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17f1df-ec7c-4120-a6e7-149e203c736b]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:48 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.410s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:49 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Deleted volume successfully.
Jul 02 05:05:49 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c
Jul 02 05:05:49 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a0232118-9ef6-4073-9351-aff06492d1ca tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-50ba25f6-a7f1-4cdb-9196-38398b3b24e5-delete_volume" released by "delete_volume" :: held 4.458s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Flow 'volume_create_manager' (fcfff58e-dd1e-499e-8300-768178dfefc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ed5cf3-60bf-49f8-aadd-305f925e3946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:49 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ed5cf3-60bf-49f8-aadd-305f925e3946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1967987550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a4200-6c63-4c0a-9e15-bbdfa71c38d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736e10207ad477d889f0c6a67b0069a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:49Z,use_quota=True,user_id='c48676c0081f43a182a96641d309f6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9896731-ef8c-434c-b8a4-d5a69a455d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9896731-ef8c-434c-b8a4-d5a69a455d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4547a669-69e9-4f89-be4b-1f48eebf2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4547a669-69e9-4f89-be4b-1f48eebf2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786a4200-6c63-4c0a-9e15-bbdfa71c38d6', 'volume_name': 'volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528b6566-5870-4f5e-9ce1-070e57d50c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528b6566-5870-4f5e-9ce1-070e57d50c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf17af0-f430-4f77-915a-2600c8673a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:49 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Volume 786a4200-6c63-4c0a-9e15-bbdfa71c38d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6', 'volume_size': 1}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 0 in 1.900s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a9f3036-7507-4d0a-b719-0b041b9ae682_61a9o0k6devstack@QuobyteHD, size 0.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:05:49 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 05:05:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:49 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1G
Jul 02 05:05:49 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:50 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 1G" returned: 0 in 1.287s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2040867-c10f-42e4-95ed-cfbe68605a93]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:51 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" returned: 0 in 2.371s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:51 devstack sudo[104094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:51 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:51 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c
Jul 02 05:05:51 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:51 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:51 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" returned: 0 in 1.576s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:52 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-quobyte-516f886f-c68c-4b70-a5b2-9c3224ec5b4c" released by "delete_volume" :: held 4.144s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:52 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 0 in 1.834s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Created reservations ['a0ac12fa-9db3-42dc-b04b-e8514677a66a', '267bab77-2dea-4565-8da4-46abdf3033b7', 'f2772115-b6a4-4326-9617-c9b91310b15a', 'b0b9e83c-7e4c-4cc3-9bc0-41a4ffbab561'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:52 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842" returned: 0 in 7.297s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:52 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:52 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb596b5-a5e3-49c9-af2d-549e0b162c78]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:52 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:52 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:53 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:05:53 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:53 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 1.396s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:05:53 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 1 in 0.847s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Downloaded image 6a9f3036-7507-4d0a-b719-0b041b9ae682 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}])) to volume 0f336619-9a4b-4f15-9468-fe8cde744fe4 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Temporary image 6a9f3036-7507-4d0a-b719-0b041b9ae682 for user dc8c57b4850045328730b68007634fc2 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Marking volume 0f336619-9a4b-4f15-9468-fe8cde744fe4 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Copying metadata from image 6a9f3036-7507-4d0a-b719-0b041b9ae682 to 0f336619-9a4b-4f15-9468-fe8cde744fe4. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Creating volume glance metadata for volume 0f336619-9a4b-4f15-9468-fe8cde744fe4 backed by image 6a9f3036-7507-4d0a-b719-0b041b9ae682 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1111d683a0d193f6df7a2883e4d880c7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 05:05:53 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.763s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Deleted volume successfully.
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-27cc2642-080f-4739-94dc-102ae52ab845 tempest-CreateVolumesFromImageTest-1852287208 None] Lock "cinder-516f886f-c68c-4b70-a5b2-9c3224ec5b4c-delete_volume" released by "delete_volume" :: held 5.336s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0f6fa2-01fe-480d-aae9-eb1baa6d6a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f336619-9a4b-4f15-9468-fe8cde744fe4', 'volume_size': 1, 'image_id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a9f3036-7507-4d0a-b719-0b041b9ae682', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1111d683a0d193f6df7a2883e4d880c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70dbe718f19940548b30166f2cb41426', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3563cc9b8a8c7a8efee296819eb834c639b5f612159e4961884201994682269a01cb9ed1b69eb3fc1460f9635ab53a249bb837762cd9f0cd1fbfa7eb5b2a80da', 'id': '6a9f3036-7507-4d0a-b719-0b041b9ae682', 'created_at': datetime.datetime(2026, 7, 2, 3, 5, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 5, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a9f3036-7507-4d0a-b719-0b041b9ae682/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab1dd6300>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e778324-2b6d-4bc4-a604-3c7906ad9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:53 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Volume volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 (0f336619-9a4b-4f15-9468-fe8cde744fe4): created successfully
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e778324-2b6d-4bc4-a604-3c7906ad9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:53 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Flow 'volume_create_manager' (6ccf3b93-d789-4fe7-89a4-f5811678d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-72cacf0c-f5be-4444-b73a-2331480e9e39 tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Created volume successfully.
Jul 02 05:05:54 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 1.092s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:05:54 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Converted 1024.00 MB image at 140.32 MB/s
Jul 02 05:05:54 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 is being set with open permissions: ugo+rw
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:54 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842
Jul 02 05:05:54 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Acquiring lock "cinder-0f336619-9a4b-4f15-9468-fe8cde744fe4-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "cinder-0f336619-9a4b-4f15-9468-fe8cde744fe4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Acquiring lock "cinder-quobyte-0f336619-9a4b-4f15-9468-fe8cde744fe4" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "cinder-quobyte-0f336619-9a4b-4f15-9468-fe8cde744fe4" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d4a24b-395d-41ed-9a14-57a5d354aca8]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:54 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842" returned: 0 in 0.776s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" released by "_copy_volume_from_snapshot" :: held 11.734s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358-83598a6f-12d6-4d5f-8f23-78812f577842" released by "_create_volume_from_snapshot" :: held 11.778s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.806s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.299s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1967987550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a4200-6c63-4c0a-9e15-bbdfa71c38d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736e10207ad477d889f0c6a67b0069a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:49Z,use_quota=True,user_id='c48676c0081f43a182a96641d309f6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Creating volume 786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:54 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:54 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 1073741824
Jul 02 05:05:54 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16253b36-374f-41e2-9fd2-e94e52be9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83598a6f-12d6-4d5f-8f23-78812f577842', 'volume_size': 1, 'snapshot_id': 'bd731118-9742-4233-9d4f-88926b8bc358'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be228754-1a49-4f65-bf0f-f97d67a2ee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Volume volume-83598a6f-12d6-4d5f-8f23-78812f577842 (83598a6f-12d6-4d5f-8f23-78812f577842): created successfully
Jul 02 05:05:54 devstack sudo[104121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:54 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be228754-1a49-4f65-bf0f-f97d67a2ee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Flow 'volume_create_manager' (50791034-93a5-4677-b98e-14c808f3f4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:54 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b2dc75a5-60b9-46ab-af04-6aeade8c1e61 tempest-VolumeDependencyTests-781908860 None] Created volume successfully.
Jul 02 05:05:55 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:55 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:55 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:55 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 1073741824" returned: 0 in 0.950s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:55 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:05:55 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-bd731118-9742-4233-9d4f-88926b8bc358-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-bd731118-9742-4233-9d4f-88926b8bc358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Deleting offline snapshot bd731118-9742-4233-9d4f-88926b8bc358 of volume db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] snapshot_file for this snap is: volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc44baf-6725-4211-b484-618377a8f1e0]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:56 devstack sudo[104135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:56 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (95cfeb0b-7ff1-40f2-9a2b-144b1d50a29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf32fb-948a-41bc-884a-4b0c877b6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 1 in 0.991s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf32fb-948a-41bc-884a-4b0c877b6709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36380763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b79eab-c76f-472d-bac6-41062b67febd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:57Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38f31cc-db02-4d8e-ae22-81aa0b4130f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38f31cc-db02-4d8e-ae22-81aa0b4130f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4
Jul 02 05:05:56 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d90dd0-4de8-4de3-b8c3-6afd3ac28cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d90dd0-4de8-4de3-b8c3-6afd3ac28cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b79eab-c76f-472d-bac6-41062b67febd', 'volume_name': 'volume-d9b79eab-c76f-472d-bac6-41062b67febd', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48bfcd3-2041-4f53-a7ee-5f236067fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48bfcd3-2041-4f53-a7ee-5f236067fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fa7a02-21d3-4708-a719-bafded51850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume d9b79eab-c76f-472d-bac6-41062b67febd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b79eab-c76f-472d-bac6-41062b67febd', 'volume_size': 1}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:56 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36380763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b79eab-c76f-472d-bac6-41062b67febd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:05:57Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume d9b79eab-c76f-472d-bac6-41062b67febd {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:05:56 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf17af0-f430-4f77-915a-2600c8673a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd 1073741824
Jul 02 05:05:56 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4482a16-766f-4767-a49d-32ea318a746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:56 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Volume volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 (786a4200-6c63-4c0a-9e15-bbdfa71c38d6): created successfully
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4482a16-766f-4767-a49d-32ea318a746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:56 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Flow 'volume_create_manager' (fcfff58e-dd1e-499e-8300-768178dfefc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-16be2038-5c4e-4319-81d3-bb4026043400 tempest-SnapshotDependencyTests-726660963 None] Created volume successfully.
Jul 02 05:05:57 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 0.971s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db99823a-b99e-4a82-9287-e857aec89e71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7156365-910b-4276-86e9-7d03ba72bbe6]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:57 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:05:57 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:57 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0f336619-9a4b-4f15-9468-fe8cde744fe4" returned: 0 in 0.717s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "cinder-quobyte-0f336619-9a4b-4f15-9468-fe8cde744fe4" released by "delete_volume" :: held 2.667s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Created reservations ['f17a187c-6496-43d3-8953-1090acd29632', '58290f1e-7d23-4a86-8863-7c2772bdd795', 'de06392e-1ae5-47e0-b4da-88b58d861921', '0a78ae07-2c65-418b-a670-b5eff59511e4'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:57 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:05:57 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:05:57 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd 1073741824" returned: 0 in 1.100s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:57 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd
Jul 02 05:05:57 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:58 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 1.070s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:58 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:58 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:58 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.838s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:05:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Deleted volume successfully.
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-35d3f795-3278-41eb-8aec-3a6c9c26485e tempest-VolumeAndVolumeTypeFromImageTest-224704137 None] Lock "cinder-0f336619-9a4b-4f15-9468-fe8cde744fe4-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:58 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd" returned: 0 in 0.751s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.880s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fa7a02-21d3-4708-a719-bafded51850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b79eab-c76f-472d-bac6-41062b67febd', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d19c99-af6e-44c4-bc10-95b426c6b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Creating offline snapshot 643ea732-8966-4e04-ac93-33b202e42bd2 of volume 786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:05:58 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-d9b79eab-c76f-472d-bac6-41062b67febd (d9b79eab-c76f-472d-bac6-41062b67febd): created successfully
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d19c99-af6e-44c4-bc10-95b426c6b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (95cfeb0b-7ff1-40f2-9a2b-144b1d50a29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdc0baa-a641-44db-87d2-d6702a886989]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:05:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e68b785c-13e8-46b5-bb20-f54a936c769e tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:05:58 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:05:58 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:59 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 0.846s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:59 devstack sudo[104173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358
Jul 02 05:05:59 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:59 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.855s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:05:59 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 1G
Jul 02 05:05:59 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:05:59 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71.bd731118-9742-4233-9d4f-88926b8bc358" returned: 0 in 0.767s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-bd731118-9742-4233-9d4f-88926b8bc358" released by "_delete_snapshot" :: held 3.784s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:05:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" released by "delete_snapshot" :: held 3.814s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Created reservations ['a48cd23e-5da6-4b4a-84e3-0706734e9412', '103450d5-7046-4d65-9a01-25d737e4e615', 'bf34ac6b-4620-44bf-ba26-ed87a553c1de', 'fb27a4da-13bd-416f-b981-94691836935e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:00 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Delete snapshot completed successfully.
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-20b261e9-3a17-4082-8934-daa0a425c0fc tempest-VolumeDependencyTests-781908860 None] Lock "cinder-bd731118-9742-4233-9d4f-88926b8bc358-delete_snapshot" released by "delete_snapshot" :: held 4.035s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-db99823a-b99e-4a82-9287-e857aec89e71-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "cinder-db99823a-b99e-4a82-9287-e857aec89e71-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (aa01f2cb-b323-477d-ae81-0003e20f6698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbed8b66-ef3e-45a7-b92d-4f8e8d52a126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbed8b66-ef3e-45a7-b92d-4f8e8d52a126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752382691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be17287-e679-4eec-95da-3ac770674c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:00Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed81df9f-7459-4fa8-b2ed-9ce9269539c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed81df9f-7459-4fa8-b2ed-9ce9269539c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c7a03f-39a3-4c4c-bf84-5cbbf21aa53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c7a03f-39a3-4c4c-bf84-5cbbf21aa53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be17287-e679-4eec-95da-3ac770674c25', 'volume_name': 'volume-7be17287-e679-4eec-95da-3ac770674c25', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f49ec-e40f-405c-bc08-ea0bf19f6275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398f49ec-e40f-405c-bc08-ea0bf19f6275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699a4fdb-efe3-468e-9cfb-957c0f80982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:00 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume 7be17287-e679-4eec-95da-3ac770674c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be17287-e679-4eec-95da-3ac770674c25', 'volume_size': 1}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" acquired by "delete_volume" :: waited 0.091s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f198498-85cd-448c-b88b-c56195880937]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:00 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 1G" returned: 0 in 1.163s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:00 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:00 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:00 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:00 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:06:00 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (84a1444f-1fd0-425f-b27b-a873e2f1ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29ae84b-ff83-4c25-ad35-56914e3ba229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29ae84b-ff83-4c25-ad35-56914e3ba229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629139461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3698596-26e4-408d-b9dd-7a23517d7cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:01Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ece8c-3f46-4a80-b522-74d0612a6b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4ece8c-3f46-4a80-b522-74d0612a6b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c9e3d0-1df5-4ee1-9f31-aed42e940252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c9e3d0-1df5-4ee1-9f31-aed42e940252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3698596-26e4-408d-b9dd-7a23517d7cf9', 'volume_name': 'volume-f3698596-26e4-408d-b9dd-7a23517d7cf9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbdfe8c-b34a-4b01-988f-b982d992cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbdfe8c-b34a-4b01-988f-b982d992cfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676e469-f826-4de2-b4a9-dd2210c6c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume f3698596-26e4-408d-b9dd-7a23517d7cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3698596-26e4-408d-b9dd-7a23517d7cf9', 'volume_size': 1}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:01 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (d6b44836-75fc-47ce-867c-d74c34a85d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d0f695-59c2-460d-ac3e-cc05bfd97b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.992s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:01 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 is being set with open permissions: ugo+rw
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d0f695-59c2-460d-ac3e-cc05bfd97b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348957198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61791a-7c4d-42ac-abc7-c20b457d1927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:02Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:01 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325a61cc-6dda-4af4-8e9a-4b69b77adcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325a61cc-6dda-4af4-8e9a-4b69b77adcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8be4fbc-a95b-4ff8-bd0e-235dd83d2cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8be4fbc-a95b-4ff8-bd0e-235dd83d2cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb61791a-7c4d-42ac-abc7-c20b457d1927', 'volume_name': 'volume-cb61791a-7c4d-42ac-abc7-c20b457d1927', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0df585-a5e7-4e5a-b29d-11f3004c9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0df585-a5e7-4e5a-b29d-11f3004c9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530aadd6-4940-42d2-a147-6de5844b5595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:01 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume cb61791a-7c4d-42ac-abc7-c20b457d1927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb61791a-7c4d-42ac-abc7-c20b457d1927', 'volume_size': 1}
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:01 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:01 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 1.250s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:02 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71
Jul 02 05:06:02 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (9b3c60e6-f8df-4fe2-b65c-0d4a2633cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172cf2f9-62ab-4297-b20f-7e3652c5d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172cf2f9-62ab-4297-b20f-7e3652c5d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000270991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff817b5-3506-4c08-a155-463fd5e0ebaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:02Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f48b80e-e637-414f-9ac4-fe93c4cf8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f48b80e-e637-414f-9ac4-fe93c4cf8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18edb974-e9ed-42c7-b220-01dac9cf764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18edb974-e9ed-42c7-b220-01dac9cf764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff817b5-3506-4c08-a155-463fd5e0ebaa', 'volume_name': 'volume-aff817b5-3506-4c08-a155-463fd5e0ebaa', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96cd97f-1004-43a1-affd-e8eadbe4703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96cd97f-1004-43a1-affd-e8eadbe4703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63d2e00-e97e-40e1-bbc7-8b5fbe6de257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume aff817b5-3506-4c08-a155-463fd5e0ebaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff817b5-3506-4c08-a155-463fd5e0ebaa', 'volume_size': 1}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:02 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.903s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (c9c61d12-674f-4ffd-8fbc-f0c61944f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7df47e-aee1-4ad2-9615-91ead7712a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7df47e-aee1-4ad2-9615-91ead7712a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468360902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfa0f22-5059-41c9-97be-f2287b33d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:03Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6865e24-298b-4fcc-9748-e25640713704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6865e24-298b-4fcc-9748-e25640713704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a922c78-ba0b-4733-995e-1ca8fb90effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a922c78-ba0b-4733-995e-1ca8fb90effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfa0f22-5059-41c9-97be-f2287b33d3b1', 'volume_name': 'volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60db0710-6c0c-4149-97c2-a79f6b2bf780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60db0710-6c0c-4149-97c2-a79f6b2bf780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dd4ec5-8cc6-46cb-953b-66900a0ac13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:02 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume 4bfa0f22-5059-41c9-97be-f2287b33d3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1', 'volume_size': 1}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:02 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info
Jul 02 05:06:02 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:02 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-db99823a-b99e-4a82-9287-e857aec89e71" returned: 0 in 0.849s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-db99823a-b99e-4a82-9287-e857aec89e71" released by "delete_volume" :: held 2.207s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Created reservations ['729b9094-b95f-415d-b815-64b0879f4c00', '4bce6305-061c-4270-99ff-bee3b95276e3', '9feef1a1-2fc5-47b0-8af9-b7746f7017c1', '3a55ee26-2aea-43fc-a2b4-d5342f17c034'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:02 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:03 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:03 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:03 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info" returned: 0 in 0.710s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:03 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info is being set with open permissions: ugo+rw
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:03 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info
Jul 02 05:06:03 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:03 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.650s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:03 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Deleted volume successfully.
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-14ab1249-7296-4129-b960-5288f623c17e tempest-VolumeDependencyTests-781908860 None] Lock "cinder-db99823a-b99e-4a82-9287-e857aec89e71-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (9e2ca1ca-664b-46d9-a5fc-91fe322fbbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82b2339-d39d-4c76-9116-d093090616d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-83598a6f-12d6-4d5f-8f23-78812f577842-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82b2339-d39d-4c76-9116-d093090616d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671829575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b206ac-dfe3-434b-aa6c-68c19a4bada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:04Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eea414-f7d9-4653-949a-7b9cb409aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eea414-f7d9-4653-949a-7b9cb409aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa689a-0a65-446b-b560-b6d7af4fd6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa689a-0a65-446b-b560-b6d7af4fd6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b206ac-dfe3-434b-aa6c-68c19a4bada8', 'volume_name': 'volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337a848-de93-46d9-a15c-216b317b25fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337a848-de93-46d9-a15c-216b317b25fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6545f51-560f-464b-a3c6-2fcdc35cccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:03 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume 47b206ac-dfe3-434b-aa6c-68c19a4bada8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8', 'volume_size': 1}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-83598a6f-12d6-4d5f-8f23-78812f577842-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" acquired by "delete_volume" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47dd013-2418-4b42-aaa8-e54dff15cdc5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:03 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:04 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842
Jul 02 05:06:04 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:04 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.info" returned: 0 in 0.710s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.579s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.583s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752382691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be17287-e679-4eec-95da-3ac770674c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:00Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume 7be17287-e679-4eec-95da-3ac770674c25 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:04 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:04 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 1073741824
Jul 02 05:06:04 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:04 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e876e7ec-1e22-4922-8561-a2902cf64d4d tempest-SnapshotDependencyTests-726660963 None] Create snapshot completed successfully
Jul 02 05:06:04 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842" returned: 0 in 0.796s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:04 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:04 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842
Jul 02 05:06:04 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:05 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 1073741824" returned: 0 in 0.850s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:05 devstack sudo[104225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25
Jul 02 05:06:05 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:05 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-83598a6f-12d6-4d5f-8f23-78812f577842" returned: 0 in 0.720s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-quobyte-83598a6f-12d6-4d5f-8f23-78812f577842" released by "delete_volume" :: held 1.563s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Created reservations ['c9e4054a-aedc-405d-b08d-d579bc721d55', '7cfdac21-68c7-42c0-8afd-f0ad0134df51', 'a5896cee-665a-4b2c-b14c-044a4eff548d', 'a23815d0-df26-449d-ace3-65a85d463e30'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:05 devstack sudo[104229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:05 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:05 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Flow 'volume_create_manager' (5a427450-010d-4bef-bcd2-25b03a1207fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e5a0db-07bf-40cf-8243-acbf63aa04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25" returned: 0 in 0.708s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.658s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629139461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3698596-26e4-408d-b9dd-7a23517d7cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:01Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume f3698596-26e4-408d-b9dd-7a23517d7cf9 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:05 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e5a0db-07bf-40cf-8243-acbf63aa04a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ca0461-86a0-44ef-9c44-8853fd2cb1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736e10207ad477d889f0c6a67b0069a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=643ea732-8966-4e04-ac93-33b202e42bd2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:06Z,use_quota=True,user_id='c48676c0081f43a182a96641d309f6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d73d2a3-3add-4da7-950b-0a0eb5419441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 1073741824
Jul 02 05:06:05 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d73d2a3-3add-4da7-950b-0a0eb5419441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a4dbf3-8edf-42f6-bec0-cf472a6b1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a4dbf3-8edf-42f6-bec0-cf472a6b1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11ca0461-86a0-44ef-9c44-8853fd2cb1c6', 'volume_name': 'volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6', 'volume_size': 1, 'snapshot_id': '643ea732-8966-4e04-ac93-33b202e42bd2'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581cc8a8-ac6d-4e14-913a-cbe8a475a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581cc8a8-ac6d-4e14-913a-cbe8a475a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12afaba3-a8d1-4300-9080-3da1fc1adb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Volume 11ca0461-86a0-44ef-9c44-8853fd2cb1c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6', 'volume_size': 1, 'snapshot_id': '643ea732-8966-4e04-ac93-33b202e42bd2'}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699a4fdb-efe3-468e-9cfb-957c0f80982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be17287-e679-4eec-95da-3ac770674c25', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e52416-bea6-4d3f-b214-531e746b0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:05 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-7be17287-e679-4eec-95da-3ac770674c25 (7be17287-e679-4eec-95da-3ac770674c25): created successfully
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e52416-bea6-4d3f-b214-531e746b0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:05 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (aa01f2cb-b323-477d-ae81-0003e20f6698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:05 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-cd93ef06-70ce-4d6b-9f6a-be60b418aff7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:06:06 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.690s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:06 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:06 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Deleted volume successfully.
Jul 02 05:06:06 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b66bfdfd-77d0-48e6-926a-f5a0a2695f84 tempest-VolumeDependencyTests-781908860 None] Lock "cinder-83598a6f-12d6-4d5f-8f23-78812f577842-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:06 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 1073741824" returned: 0 in 0.942s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:06 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:06 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9
Jul 02 05:06:06 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:07 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9" returned: 0 in 0.687s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.655s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348957198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb61791a-7c4d-42ac-abc7-c20b457d1927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:02Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume cb61791a-7c4d-42ac-abc7-c20b457d1927 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:07 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676e469-f826-4de2-b4a9-dd2210c6c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3698596-26e4-408d-b9dd-7a23517d7cf9', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:07 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 1073741824
Jul 02 05:06:07 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd59793c-5fc3-45b5-9882-50ae3fed0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:07 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 (f3698596-26e4-408d-b9dd-7a23517d7cf9): created successfully
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd59793c-5fc3-45b5-9882-50ae3fed0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:07 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (84a1444f-1fd0-425f-b27b-a873e2f1ded3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:07 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e6a9bc3f-2f49-4b61-a553-663dd8e89144 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:06:08 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 1073741824" returned: 0 in 0.860s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:08 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:08 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927
Jul 02 05:06:08 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:09 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927" returned: 0 in 0.625s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.805s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000270991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff817b5-3506-4c08-a155-463fd5e0ebaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:02Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume aff817b5-3506-4c08-a155-463fd5e0ebaa {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:09 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:09 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa 1073741824
Jul 02 05:06:09 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530aadd6-4940-42d2-a147-6de5844b5595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb61791a-7c4d-42ac-abc7-c20b457d1927', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d3379-36c4-4156-99d5-495eb6a97ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Flow 'volume_create_manager' (6a216d92-4fe6-46ea-a8ca-e8fb43dfbef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66e4357-2609-496c-9aa9-eff92a1d170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 (cb61791a-7c4d-42ac-abc7-c20b457d1927): created successfully
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d3379-36c4-4156-99d5-495eb6a97ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (d6b44836-75fc-47ce-867c-d74c34a85d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66e4357-2609-496c-9aa9-eff92a1d170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51244c6-2f6d-425d-943b-3673587bc95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3251bce3693428f9a8860f9a24720bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:09Z,use_quota=True,user_id='6a5b413565e04fb5827222cbc2144714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a9ef3-bb68-443a-a4ff-ea8addd8fbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a9ef3-bb68-443a-a4ff-ea8addd8fbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f7b00-55d1-455a-8e37-498ebf8345a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f7b00-55d1-455a-8e37-498ebf8345a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51244c6-2f6d-425d-943b-3673587bc95c', 'volume_name': 'volume-a51244c6-2f6d-425d-943b-3673587bc95c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f888f7c-78fb-4b43-9a74-c072655d17fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f888f7c-78fb-4b43-9a74-c072655d17fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7d6c4b-1404-4348-a9e3-cbcb20173ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:09 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Volume a51244c6-2f6d-425d-943b-3673587bc95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51244c6-2f6d-425d-943b-3673587bc95c', 'volume_size': 1}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:09 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3c1752f4-9082-4299-8209-7d1319a287f2 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:06:09 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa 1073741824" returned: 0 in 0.811s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:09 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:09 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa
Jul 02 05:06:09 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:10 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa" returned: 0 in 0.670s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.826s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468360902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfa0f22-5059-41c9-97be-f2287b33d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5e292570c6470cbd6e54a266c0ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:03Z,use_quota=True,user_id='a541309471fc4e498004545920b5b404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Creating volume 4bfa0f22-5059-41c9-97be-f2287b33d3b1 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:10 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:10 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 1073741824
Jul 02 05:06:10 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63d2e00-e97e-40e1-bbc7-8b5fbe6de257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff817b5-3506-4c08-a155-463fd5e0ebaa', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993c40-743f-453d-8134-64aa923a4667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:10 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-aff817b5-3506-4c08-a155-463fd5e0ebaa (aff817b5-3506-4c08-a155-463fd5e0ebaa): created successfully
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993c40-743f-453d-8134-64aa923a4667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:10 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (9b3c60e6-f8df-4fe2-b65c-0d4a2633cc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:10 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e18d1969-d9dc-454d-9b85-c972e99715f7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:06:11 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 1073741824" returned: 0 in 0.833s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:11 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:11 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1
Jul 02 05:06:11 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:12 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1" returned: 0 in 0.641s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.206s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1671829575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b206ac-dfe3-434b-aa6c-68c19a4bada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:04Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume 47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:12 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:12 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 1073741824
Jul 02 05:06:12 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dd4ec5-8cc6-46cb-953b-66900a0ac13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5705ae61-8f87-4ee4-be70-166b2dbc0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:12 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Volume volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 (4bfa0f22-5059-41c9-97be-f2287b33d3b1): created successfully
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5705ae61-8f87-4ee4-be70-166b2dbc0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Flow 'volume_create_manager' (c9c61d12-674f-4ffd-8fbc-f0c61944f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:12 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a3ac6fd7-a2aa-4e75-a2c7-ad57cbe871a1 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created volume successfully.
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-4bfa0f22-5059-41c9-97be-f2287b33d3b1-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-4bfa0f22-5059-41c9-97be-f2287b33d3b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-4bfa0f22-5059-41c9-97be-f2287b33d3b1" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-4bfa0f22-5059-41c9-97be-f2287b33d3b1" acquired by "delete_volume" :: waited 0.027s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66569013-6c8e-496e-b2ca-ecefcc18a0a7]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:12 devstack sudo[104268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1
Jul 02 05:06:12 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:12 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:12 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 1073741824" returned: 0 in 0.836s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:13 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8
Jul 02 05:06:13 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:13 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1" returned: 0 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:13 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1
Jul 02 05:06:13 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:13 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8" returned: 0 in 0.690s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.740s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" by "_create_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6545f51-560f-464b-a3c6-2fcdc35cccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e747c-4f8a-46ad-bd88-6e2b0a65f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Creating volume 11ca0461-86a0-44ef-9c44-8853fd2cb1c6 from snapshot 643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" by "_copy_volume_from_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:13 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 (47b206ac-dfe3-434b-aa6c-68c19a4bada8): created successfully
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e747c-4f8a-46ad-bd88-6e2b0a65f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (9e2ca1ca-664b-46d9-a5fc-91fe322fbbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] snapshot: 643ea732-8966-4e04-ac93-33b202e42bd2, volume: 11ca0461-86a0-44ef-9c44-8853fd2cb1c6,  {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 02 05:06:13 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-9292bd4f-8dfd-47ed-be5a-66bb6712853e tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315c9fe-ad3d-406f-982d-b00b25dedcc9]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:13 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:13 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:13 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:14 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-4bfa0f22-5059-41c9-97be-f2287b33d3b1" returned: 0 in 0.675s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-4bfa0f22-5059-41c9-97be-f2287b33d3b1" released by "delete_volume" :: held 1.505s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['a570e6e0-ed6f-4da0-b03d-f856a338b94a', '5fb5bf88-22a2-4dba-bad3-2d8794dfebb7', 'ab3ec0b8-5c42-4c07-a667-f4a3c87235da', 'c21a9b1a-f54f-4643-b5a0-0513d45e79ad'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:14 devstack sudo[104284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:14 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:14 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.848s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Creating direct copy from snapshot {{(pid=86158) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4bb53d-183c-4e4a-ab4d-e696fd002117]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-aff817b5-3506-4c08-a155-463fd5e0ebaa-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-aff817b5-3506-4c08-a155-463fd5e0ebaa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-aff817b5-3506-4c08-a155-463fd5e0ebaa" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-aff817b5-3506-4c08-a155-463fd5e0ebaa" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[41388533-7ebb-4441-abfd-8cb576712257]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:14 devstack sudo[104289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:06:14 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:14 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:14 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:14 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-d2ebac43-e8bf-4709-9886-ca6c0268a734 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-4bfa0f22-5059-41c9-97be-f2287b33d3b1-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:14 devstack sudo[104292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa
Jul 02 05:06:14 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:15 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.834s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:15 devstack cinder-volume[86158]: DEBUG cinder.utils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Path /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 not found in is_blk_device check {{(pid=86158) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 02 05:06:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:15 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6
Jul 02 05:06:15 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:15 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa" returned: 0 in 0.747s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:15 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:15 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa
Jul 02 05:06:15 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:16 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-aff817b5-3506-4c08-a155-463fd5e0ebaa" returned: 0 in 0.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-aff817b5-3506-4c08-a155-463fd5e0ebaa" released by "delete_volume" :: held 1.467s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['f5774ce6-d73f-42fd-a384-c782c30464ff', 'fb99ee8b-03d2-4e68-933b-70131928c87a', 'e6a423ef-7f3e-4907-a1bb-20769d855c83', 'f397cde5-1c2f-4a35-b1a3-c3dbbc9f975c'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:16 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:16 devstack sudo[104316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:16 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-cb61791a-7c4d-42ac-abc7-c20b457d1927-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-cb61791a-7c4d-42ac-abc7-c20b457d1927-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-cb61791a-7c4d-42ac-abc7-c20b457d1927" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-cb61791a-7c4d-42ac-abc7-c20b457d1927" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691ff04-049d-4964-9d73-e9ddbc73c4aa]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:17 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:17 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927
Jul 02 05:06:17 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:18 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:18 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 2.275s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:18 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:18 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:18 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-bfa9473c-1986-4459-b8dc-9ff38e9755a7 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-aff817b5-3506-4c08-a155-463fd5e0ebaa-delete_volume" released by "delete_volume" :: held 4.138s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:19 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927" returned: 0 in 1.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:19 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:19 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927
Jul 02 05:06:19 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:20 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-cb61791a-7c4d-42ac-abc7-c20b457d1927" returned: 0 in 1.620s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-cb61791a-7c4d-42ac-abc7-c20b457d1927" released by "delete_volume" :: held 3.442s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['09bfd6e2-98cf-417a-b0b7-bbc321ba5cb8', '04bd4fe5-8c71-4c2a-8c59-761295844246', '48153c4f-5355-4b94-8063-ad4f20651598', 'fb0ce793-047e-47ee-abf1-9f6b4d503258'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:20 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:20 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:20 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" returned: 0 in 5.380s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ad1c4-051b-44f3-b302-d4a2def8cd6f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:20 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:21 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:06:21 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:21 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.656s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:21 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5ee8eb61-48d4-42a2-ae46-22b9e67e4bb6 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-cb61791a-7c4d-42ac-abc7-c20b457d1927-delete_volume" released by "delete_volume" :: held 4.459s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-f3698596-26e4-408d-b9dd-7a23517d7cf9-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-f3698596-26e4-408d-b9dd-7a23517d7cf9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=108,cinder:UPDATE=147,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:06:21 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.969s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-f3698596-26e4-408d-b9dd-7a23517d7cf9" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Image conversion details: src /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:06:21 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Converted 1024.00 MB image at 190.27 MB/s
Jul 02 05:06:21 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 is being set with open permissions: ugo+rw
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-f3698596-26e4-408d-b9dd-7a23517d7cf9" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:21 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6
Jul 02 05:06:21 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd846f03-ce51-4afe-ab18-2a13fd8d15e4]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:21 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:22 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9
Jul 02 05:06:22 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:22 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" returned: 0 in 0.644s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" released by "_copy_volume_from_snapshot" :: held 8.794s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" released by "_create_volume_from_snapshot" :: held 8.843s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.881s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.342s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51244c6-2f6d-425d-943b-3673587bc95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3251bce3693428f9a8860f9a24720bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:09Z,use_quota=True,user_id='6a5b413565e04fb5827222cbc2144714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Creating volume a51244c6-2f6d-425d-943b-3673587bc95c {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:22 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:22 devstack sudo[104346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c 1073741824
Jul 02 05:06:22 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=148,cinder:SELECT=113,cinder:DELETE=17,cinder:INSERT=33 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12afaba3-a8d1-4300-9080-3da1fc1adb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6', 'volume_size': 1, 'snapshot_id': '643ea732-8966-4e04-ac93-33b202e42bd2'}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e46671-e7d1-497b-8146-5d46b8164ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:22 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Volume volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 (11ca0461-86a0-44ef-9c44-8853fd2cb1c6): created successfully
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e46671-e7d1-497b-8146-5d46b8164ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Flow 'volume_create_manager' (5a427450-010d-4bef-bcd2-25b03a1207fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:22 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e74665e2-1260-4bdf-a5e9-9c40df8cc261 tempest-SnapshotDependencyTests-726660963 None] Created volume successfully.
Jul 02 05:06:22 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9" returned: 0 in 0.766s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:22 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:22 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9
Jul 02 05:06:22 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-643ea732-8966-4e04-ac93-33b202e42bd2-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-643ea732-8966-4e04-ac93-33b202e42bd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Deleting offline snapshot 643ea732-8966-4e04-ac93-33b202e42bd2 of volume 786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] snapshot_file for this snap is: volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[647036a0-744e-40da-bf8d-176cf8aa59f1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:23 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:23 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:23 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f3698596-26e4-408d-b9dd-7a23517d7cf9" returned: 0 in 0.698s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:23 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-f3698596-26e4-408d-b9dd-7a23517d7cf9" released by "delete_volume" :: held 1.519s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c 1073741824" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['eabe2685-d0d2-452d-b514-49a9ef2d9a74', '510236ab-e526-4daa-91ca-f0ba679fe1e0', '67e58b01-7de8-4c4d-8a96-dddddddde7ac', '04e069b4-a298-45ef-a3ed-8f737a517e96'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:23 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c
Jul 02 05:06:23 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:23 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:23 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:23 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:24 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.806s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c62d5-b8e6-4db1-8622-496efadad526]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-7be17287-e679-4eec-95da-3ac770674c25-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-7be17287-e679-4eec-95da-3ac770674c25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:24 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c" returned: 0 in 0.682s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.514s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-7be17287-e679-4eec-95da-3ac770674c25" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating offline snapshot 4452d332-2e74-400d-9c91-764e59015fa0 of volume 47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7d6c4b-1404-4348-a9e3-cbcb20173ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51244c6-2f6d-425d-943b-3673587bc95c', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a68dc86-042a-4f39-a035-e9bce1cb9386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-7be17287-e679-4eec-95da-3ac770674c25" acquired by "delete_volume" :: waited 0.047s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b4161-066d-4513-a77c-b224c7f5cccd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:24 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:24 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8401559-406b-422b-97e5-499f70b19699]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:24 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Volume volume-a51244c6-2f6d-425d-943b-3673587bc95c (a51244c6-2f6d-425d-943b-3673587bc95c): created successfully
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a68dc86-042a-4f39-a035-e9bce1cb9386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Flow 'volume_create_manager' (6a216d92-4fe6-46ea-a8ca-e8fb43dfbef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-43f6ae77-6d83-4020-a3bd-da95f9cd841e tempest-CinderUnicodeTest-244983685 None] Created volume successfully.
Jul 02 05:06:24 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8
Jul 02 05:06:24 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:24 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:24 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:24 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-c4601fec-9e0b-42d9-ad0f-5e834c2ffa27 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-f3698596-26e4-408d-b9dd-7a23517d7cf9-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:24 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25
Jul 02 05:06:24 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:25 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.950s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:25 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:25 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:25 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8" returned: 0 in 0.815s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:25 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 1G
Jul 02 05:06:25 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:25 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25" returned: 0 in 0.870s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:25 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25
Jul 02 05:06:25 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:25 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.894s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:25 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2
Jul 02 05:06:25 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:25 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-7be17287-e679-4eec-95da-3ac770674c25" returned: 0 in 0.783s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Flow 'volume_create_manager' (98f3907a-2a54-42fb-a301-d3aebc8ca78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf541fd5-232d-4b7a-9861-47e4ff91aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:25 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-7be17287-e679-4eec-95da-3ac770674c25" released by "delete_volume" :: held 1.732s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf541fd5-232d-4b7a-9861-47e4ff91aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1817138192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0669005b-cffe-4982-a14c-45ca46cfc1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3251bce3693428f9a8860f9a24720bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:26Z,use_quota=True,user_id='6a5b413565e04fb5827222cbc2144714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6079aa36-25f1-4edc-9dd4-5c130a6d3ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6079aa36-25f1-4edc-9dd4-5c130a6d3ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859055a0-e886-4d9d-a179-f198a09cdca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859055a0-e886-4d9d-a179-f198a09cdca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0669005b-cffe-4982-a14c-45ca46cfc1a8', 'volume_name': 'volume-0669005b-cffe-4982-a14c-45ca46cfc1a8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330c1ad2-048f-4357-baaa-4b44eed3cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330c1ad2-048f-4357-baaa-4b44eed3cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b329f702-b068-431e-b686-27448c70a3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:26 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Volume 0669005b-cffe-4982-a14c-45ca46cfc1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0669005b-cffe-4982-a14c-45ca46cfc1a8', 'volume_size': 1}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['6d591618-7464-4456-bf24-f4b862ed53e6', '61b02f5d-e955-4250-a627-39012b6db387', '57dbafa7-09cd-4369-8e70-2b7f84f1b074', 'b2faa795-9f90-4020-a45e-3309fb115632'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:26 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 1G" returned: 0 in 1.012s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:26 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0
Jul 02 05:06:26 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:26 devstack sudo[104400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:26 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-d9b79eab-c76f-472d-bac6-41062b67febd-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-d9b79eab-c76f-472d-bac6-41062b67febd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "cinder-quobyte-d9b79eab-c76f-472d-bac6-41062b67febd" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6.643ea732-8966-4e04-ac93-33b202e42bd2" returned: 0 in 0.705s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:26 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-d9b79eab-c76f-472d-bac6-41062b67febd" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b91232-54a2-4ab0-9c3c-b75abd504def]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-643ea732-8966-4e04-ac93-33b202e42bd2" released by "_delete_snapshot" :: held 3.488s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" released by "delete_snapshot" :: held 3.520s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Created reservations ['e9134aab-7550-4fbd-b33d-d7335eb282db', 'a18799d9-be49-44f5-8e79-ac3f43d52afb', '029ce9a6-3f94-4ead-a819-4f8b44555ca8', '7a52b9c8-4956-4413-901a-08ae1876839d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:26 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd
Jul 02 05:06:26 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:26 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Delete snapshot completed successfully.
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-3b230a76-7a59-4c94-a1bf-a77decb24f76 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-643ea732-8966-4e04-ac93-33b202e42bd2-delete_snapshot" released by "delete_snapshot" :: held 3.697s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:26 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.800s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:26 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:26 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:27 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0" returned: 0 in 0.898s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:27 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 is being set with open permissions: ugo+rw
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-079a6cae-0a70-4c4b-8410-d9eef2363505 tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-7be17287-e679-4eec-95da-3ac770674c25-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:27 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0
Jul 02 05:06:27 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-786a4200-6c63-4c0a-9e15-bbdfa71c38d6-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-786a4200-6c63-4c0a-9e15-bbdfa71c38d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4dee82-93a6-4cae-b72c-4cb19b74a6fd]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:27 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd" returned: 0 in 0.932s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:27 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd
Jul 02 05:06:27 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:27 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:06:27 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:27 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0" returned: 0 in 0.693s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:27 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:27 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info
Jul 02 05:06:27 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:28 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-d9b79eab-c76f-472d-bac6-41062b67febd" returned: 0 in 0.678s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-quobyte-d9b79eab-c76f-472d-bac6-41062b67febd" released by "delete_volume" :: held 1.672s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Created reservations ['1b983c7b-a801-49df-84a0-42305c7c437f', 'ce347c44-0b39-47af-8d3a-ad28d7550df9', 'be46cc03-3d03-40b7-ba51-fb701c6bc2ab', '6e34eb3d-b738-46c1-b2a0-e9fb29c3e95d'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:28 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.840s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:28 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info" returned: 0 in 0.661s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:28 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info is being set with open permissions: ugo+rw
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:28 devstack sudo[104428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6
Jul 02 05:06:28 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:28 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:28 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:28 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:28 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:28 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:29 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.info" returned: 0 in 0.707s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:29 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.922s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.082s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1817138192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0669005b-cffe-4982-a14c-45ca46cfc1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3251bce3693428f9a8860f9a24720bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:26Z,use_quota=True,user_id='6a5b413565e04fb5827222cbc2144714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Creating volume 0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:29 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" returned: 0 in 0.793s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:29 devstack sudo[104437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 1073741824
Jul 02 05:06:29 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:29 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-786a4200-6c63-4c0a-9e15-bbdfa71c38d6" released by "delete_volume" :: held 1.700s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.760s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Deleted volume successfully.
Jul 02 05:06:29 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e69ddf12-0e83-4639-a431-2359f29581c8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Create snapshot completed successfully
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4e329722-7c3c-4dcb-9598-bce62afdd6ee tempest-CreateVolumesFromSourceVolumeTest-9859349 None] Lock "cinder-d9b79eab-c76f-472d-bac6-41062b67febd-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Created reservations ['79a5eb3c-6e64-4d9a-af9d-0bed3d51f025', 'dfe0768b-ed83-483d-9003-e5f63dfb3059', '581b06ad-0f3a-419a-a216-7baba2b097b0', 'af4eee01-3510-433d-b360-2c09e550c044'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:29 devstack sudo[104439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:29 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-11ca0461-86a0-44ef-9c44-8853fd2cb1c6-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-11ca0461-86a0-44ef-9c44-8853fd2cb1c6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d6436-a6de-44ed-bba4-4c2d5f0781b8]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:29 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:30 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6
Jul 02 05:06:30 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:30 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.964s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:30 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Deleted volume successfully.
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (679d5415-9db4-4e33-96f8-7297a6c34e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b3d483-b63b-4a7e-9442-d2c6566c008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-a8c5d2cb-4e41-4a7f-9dd5-8edf41acadd0 tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-786a4200-6c63-4c0a-9e15-bbdfa71c38d6-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 1073741824" returned: 0 in 1.336s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b3d483-b63b-4a7e-9442-d2c6566c008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114444983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693819dd-81b0-4fde-8206-85544be32190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:30Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d07544e-13a0-436c-8fbb-57b426dc6034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d07544e-13a0-436c-8fbb-57b426dc6034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18254895-00c3-4b59-8cef-3c367dbd4819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18254895-00c3-4b59-8cef-3c367dbd4819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693819dd-81b0-4fde-8206-85544be32190', 'volume_name': 'volume-693819dd-81b0-4fde-8206-85544be32190', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8f2d7-0c08-45f2-bfa9-05de93a78fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8f2d7-0c08-45f2-bfa9-05de93a78fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e75b28-1533-4ddc-8fcf-1de2b28a103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume 693819dd-81b0-4fde-8206-85544be32190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693819dd-81b0-4fde-8206-85544be32190', 'volume_size': 1}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:30 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8
Jul 02 05:06:30 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (ad5f7a53-d434-4171-8b08-aad925f7574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6fdf64-6281-48b6-9871-3d7333fc8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6fdf64-6281-48b6-9871-3d7333fc8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392252336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309f6789-218c-432c-a82a-84d5a179bacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:31Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e146ed-fa7a-4f6b-b79b-a7697e38c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e146ed-fa7a-4f6b-b79b-a7697e38c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6275e6-8e06-4304-831a-0bc9bb64d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6275e6-8e06-4304-831a-0bc9bb64d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309f6789-218c-432c-a82a-84d5a179bacf', 'volume_name': 'volume-309f6789-218c-432c-a82a-84d5a179bacf', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fff152-8647-4736-a1bf-6b9e9e46d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fff152-8647-4736-a1bf-6b9e9e46d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06249744-1bac-411a-ac52-e00afa7050b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:30 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume 309f6789-218c-432c-a82a-84d5a179bacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309f6789-218c-432c-a82a-84d5a179bacf', 'volume_size': 1}
Jul 02 05:06:30 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:31 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (76277bf7-7339-4d3e-820f-00717d70481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79561a69-81b0-4e44-9798-331ca7eccf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" returned: 0 in 1.430s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79561a69-81b0-4e44-9798-331ca7eccf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794525916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77092eaa-6d81-4c8e-b1b7-7209e7025a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:31Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723ca2a2-64bc-48d7-b642-842e9b0bd24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723ca2a2-64bc-48d7-b642-842e9b0bd24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9775e06-462e-469e-9f20-0d79ec87a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9775e06-462e-469e-9f20-0d79ec87a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77092eaa-6d81-4c8e-b1b7-7209e7025a41', 'volume_name': 'volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ece35-9b9a-4f65-8b1d-05fce4f33494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6
Jul 02 05:06:31 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81ece35-9b9a-4f65-8b1d-05fce4f33494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f837d46e-029c-434d-9a08-d41c8de3e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume 77092eaa-6d81-4c8e-b1b7-7209e7025a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41', 'volume_size': 1}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:31 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8" returned: 0 in 0.933s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114444983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693819dd-81b0-4fde-8206-85544be32190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:30Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume 693819dd-81b0-4fde-8206-85544be32190 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:31 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:31 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 1073741824
Jul 02 05:06:31 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b329f702-b068-431e-b686-27448c70a3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0669005b-cffe-4982-a14c-45ca46cfc1a8', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddacea7-6b4b-438f-924e-65c9bc0c303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Volume volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 (0669005b-cffe-4982-a14c-45ca46cfc1a8): created successfully
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddacea7-6b4b-438f-924e-65c9bc0c303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Flow 'volume_create_manager' (98f3907a-2a54-42fb-a301-d3aebc8ca78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:31 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-def6e2d0-4b7b-4e93-b2b2-1f055d1346d2 tempest-CinderUnicodeTest-244983685 None] Created volume successfully.
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (8f97a859-dd4e-47d3-bfa5-dfea8773f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b0d064-6e59-4c20-b43a-79494051a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:31 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b0d064-6e59-4c20-b43a-79494051a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690730224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a18b72a-ef70-4b8e-942f-f0d0a7d5678b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:32Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576201b1-9f7e-42d1-8391-3c25c5711860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576201b1-9f7e-42d1-8391-3c25c5711860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fe3af7-ca4e-4260-b43c-d96c4f26a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fe3af7-ca4e-4260-b43c-d96c4f26a188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a18b72a-ef70-4b8e-942f-f0d0a7d5678b', 'volume_name': 'volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd201cd8-783d-4405-b4b1-966b11f4edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd201cd8-783d-4405-b4b1-966b11f4edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fabcc7e-6ed0-48c5-91c6-8a511bc4fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume 8a18b72a-ef70-4b8e-942f-f0d0a7d5678b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b', 'volume_size': 1}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:32 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" returned: 0 in 0.937s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-quobyte-11ca0461-86a0-44ef-9c44-8853fd2cb1c6" released by "delete_volume" :: held 2.489s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (3dc0d135-fe8f-42f1-9763-4eba849cca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccc1a06-f1d0-4683-a05c-e0922343bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Created reservations ['8375f31b-c41b-41ca-93f1-6d351600b252', '854d3372-c662-4f83-9b28-25b03f09a437', '75ca9d00-b5be-46c5-b535-9c596b4db18d', '378bc4a6-af6a-428c-85d1-e23cba300ca3'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccc1a06-f1d0-4683-a05c-e0922343bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833493731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15425f7-540f-4e33-a3c6-3a47f74aabed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:32Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d578e62f-b77b-49cd-b98f-890bf43bdbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d578e62f-b77b-49cd-b98f-890bf43bdbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66a247-e81e-479a-b3d1-6c1b667913dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff66a247-e81e-479a-b3d1-6c1b667913dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15425f7-540f-4e33-a3c6-3a47f74aabed', 'volume_name': 'volume-f15425f7-540f-4e33-a3c6-3a47f74aabed', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48993a-c795-4d7e-a98f-8f9037f1a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48993a-c795-4d7e-a98f-8f9037f1a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62fc288-95db-4b85-b707-d3e5fee557ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:32 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume f15425f7-540f-4e33-a3c6-3a47f74aabed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15425f7-540f-4e33-a3c6-3a47f74aabed', 'volume_size': 1}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:32 devstack sudo[104464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:32 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:32 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 1073741824" returned: 0 in 1.263s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:32 devstack sudo[104466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190
Jul 02 05:06:32 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:32 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:33 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.801s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Deleted volume successfully.
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-701b3aba-96bb-4ed4-8a64-841e95e9955d tempest-SnapshotDependencyTests-726660963 None] Lock "cinder-11ca0461-86a0-44ef-9c44-8853fd2cb1c6-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:33 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190" returned: 0 in 0.750s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392252336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309f6789-218c-432c-a82a-84d5a179bacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:31Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume 309f6789-218c-432c-a82a-84d5a179bacf {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:33 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e75b28-1533-4ddc-8fcf-1de2b28a103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693819dd-81b0-4fde-8206-85544be32190', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:33 devstack sudo[104470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf 1073741824
Jul 02 05:06:33 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db34d0db-25cd-4f96-96b0-b2f5ac6e7608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:33 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-693819dd-81b0-4fde-8206-85544be32190 (693819dd-81b0-4fde-8206-85544be32190): created successfully
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db34d0db-25cd-4f96-96b0-b2f5ac6e7608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:33 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (679d5415-9db4-4e33-96f8-7297a6c34e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:33 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-34df0859-cbfc-4037-aa0e-810de218da52 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:34 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf 1073741824" returned: 0 in 0.978s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:34 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:34 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf
Jul 02 05:06:34 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:35 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf" returned: 0 in 0.706s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.906s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794525916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77092eaa-6d81-4c8e-b1b7-7209e7025a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:31Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume 77092eaa-6d81-4c8e-b1b7-7209e7025a41 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:35 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06249744-1bac-411a-ac52-e00afa7050b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309f6789-218c-432c-a82a-84d5a179bacf', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7699d259-6a25-4553-bc21-055be5f48858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:35 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 1073741824
Jul 02 05:06:35 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:35 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-309f6789-218c-432c-a82a-84d5a179bacf (309f6789-218c-432c-a82a-84d5a179bacf): created successfully
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7699d259-6a25-4553-bc21-055be5f48858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (ad5f7a53-d434-4171-8b08-aad925f7574d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:35 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-ec310999-ad96-4861-a93f-eea56dddc7e6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86158) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Flow 'volume_create_manager' (0e3d84c6-f561-47e3-90f8-efee4a149264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4201f41-ca19-41fa-bcc8-54955282dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4201f41-ca19-41fa-bcc8-54955282dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b530b7-cca5-4ddc-821d-19c47980f3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588dc311e1e4ed6bfdc7cdd84ba7085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:36Z,use_quota=True,user_id='ba8dbf363cb046c99a321d49f6ec4360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8a57a6-a6ca-4b6b-857c-0e93adf60a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8a57a6-a6ca-4b6b-857c-0e93adf60a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8245543-1968-48a5-a865-105cca119d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:35 devstack cinder-volume[86158]: DEBUG cinder.image.glance [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Creating Keystone auth plugin from conf {{(pid=86158) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8245543-1968-48a5-a865-105cca119d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3b530b7-cca5-4ddc-821d-19c47980f3e2', 'volume_name': 'volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2', 'volume_size': 1, 'image_id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98b71b159e1f4eff448c5292ba6eb55a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b588dc311e1e4ed6bfdc7cdd84ba7085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edef30a82e1f63eb0ae2678d4ce99e5ff245833a3b65adc0c131ee66c449209d1ff734a9e19f81ceff2f73e38e9729dcb0d98830b99c2a65edb0e96eb50c9625', 'id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'created_at': datetime.datetime(2026, 7, 2, 3, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac2c478-76a3-43db-b1a5-748c801c35dd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab25f40b0>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3facca-7296-4b9a-a830-ac05714f63dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3facca-7296-4b9a-a830-ac05714f63dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef134d-0f76-49f7-9f06-177c373b86c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:36 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Volume e3b530b7-cca5-4ddc-821d-19c47980f3e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2', 'volume_size': 1, 'image_id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98b71b159e1f4eff448c5292ba6eb55a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b588dc311e1e4ed6bfdc7cdd84ba7085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edef30a82e1f63eb0ae2678d4ce99e5ff245833a3b65adc0c131ee66c449209d1ff734a9e19f81ceff2f73e38e9729dcb0d98830b99c2a65edb0e96eb50c9625', 'id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'created_at': datetime.datetime(2026, 7, 2, 3, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac2c478-76a3-43db-b1a5-748c801c35dd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab25f40b0>}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Trying to clone e3b530b7-cca5-4ddc-821d-19c47980f3e2 from image fac2c478-76a3-43db-b1a5-748c801c35dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}]). {{(pid=86158) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 02 05:06:36 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Image download 0.00 MB at 0.00 MB/s
Jul 02 05:06:36 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 1073741824" returned: 0 in 1.112s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[34018551-08bd-4921-aaa8-2af772c55cfa]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:36 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:36 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41
Jul 02 05:06:36 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:36 devstack sudo[104487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:36 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:37 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41" returned: 0 in 0.784s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.269s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690730224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a18b72a-ef70-4b8e-942f-f0d0a7d5678b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:32Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume 8a18b72a-ef70-4b8e-942f-f0d0a7d5678b {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:37 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f837d46e-029c-434d-9a08-d41c8de3e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92afd6-0c06-429f-8a7a-a030c7f9e7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:37 devstack sudo[104494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b 1073741824
Jul 02 05:06:37 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:37 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 (77092eaa-6d81-4c8e-b1b7-7209e7025a41): created successfully
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92afd6-0c06-429f-8a7a-a030c7f9e7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (76277bf7-7339-4d3e-820f-00717d70481b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:37 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:37 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:37 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-d00221d5-6f48-4d8a-8342-7a63342db8cb tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:37 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:37 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:38 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Temporary image fac2c478-76a3-43db-b1a5-748c801c35dd is fetched for user ba8dbf363cb046c99a321d49f6ec4360. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 02 05:06:38 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b 1073741824" returned: 0 in 0.959s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[07684c43-bfe9-4ea4-bda3-fc97e95b6b8c]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:38 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:38 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b
Jul 02 05:06:38 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:38 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:38 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:39 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" returned: 0 in 0.707s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.495s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833493731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15425f7-540f-4e33-a3c6-3a47f74aabed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68f4eb876564d538d54d9e566ac2c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:32Z,use_quota=True,user_id='a4eaf58a7302414ebe3117bf2f6f16f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Creating volume f15425f7-540f-4e33-a3c6-3a47f74aabed {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:39 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:39 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed 1073741824
Jul 02 05:06:39 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fabcc7e-6ed0-48c5-91c6-8a511bc4fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc2d48a-88b6-42dd-8c84-db141e804dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:39 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b (8a18b72a-ef70-4b8e-942f-f0d0a7d5678b): created successfully
Jul 02 05:06:39 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc2d48a-88b6-42dd-8c84-db141e804dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (8f97a859-dd4e-47d3-bfa5-dfea8773f634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:39 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-c98aa0d3-9479-4639-a79e-952bf6d65f06 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:39 devstack sudo[104515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:39 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:39 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 1 in 0.807s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:39 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:40 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed 1073741824" returned: 0 in 0.955s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:40 devstack sudo[104525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed
Jul 02 05:06:40 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:40 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed" returned: 0 in 0.712s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.861s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62fc288-95db-4b85-b707-d3e5fee557ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15425f7-540f-4e33-a3c6-3a47f74aabed', 'volume_size': 1}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58820d8-e4b9-48b3-90e5-ac3614811a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Creating offline snapshot 62184eb4-97cf-4a22-9eb2-bea60a72bdaa of volume 0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 02 05:06:40 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Volume volume-f15425f7-540f-4e33-a3c6-3a47f74aabed (f15425f7-540f-4e33-a3c6-3a47f74aabed): created successfully
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58820d8-e4b9-48b3-90e5-ac3614811a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Flow 'volume_create_manager' (3dc0d135-fe8f-42f1-9763-4eba849cca1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f15354-dca7-4522-b011-f79fedddc08a]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:40 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:40 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-6b4ff549-4375-4d21-a5ad-11e8bc0f42e0 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created volume successfully.
Jul 02 05:06:40 devstack sudo[104528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8
Jul 02 05:06:40 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-f15425f7-540f-4e33-a3c6-3a47f74aabed-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-f15425f7-540f-4e33-a3c6-3a47f74aabed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-f15425f7-540f-4e33-a3c6-3a47f74aabed" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-f15425f7-540f-4e33-a3c6-3a47f74aabed" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757b2de-6b51-46bb-a818-bc51f6c1578d]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:41 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed
Jul 02 05:06:41 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:41 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8" returned: 0 in 0.938s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:41 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:41 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa 1G
Jul 02 05:06:41 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:42 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed" returned: 0 in 0.891s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:42 devstack sudo[104542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed
Jul 02 05:06:42 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:42 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa 1G" returned: 0 in 0.940s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:42 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:42 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa
Jul 02 05:06:42 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:43 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-f15425f7-540f-4e33-a3c6-3a47f74aabed" returned: 0 in 0.732s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-f15425f7-540f-4e33-a3c6-3a47f74aabed" released by "delete_volume" :: held 1.682s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['b8413879-96d2-4247-b792-9c118f4b9603', 'c15736cd-de59-4c06-8e3d-faeb49aa3d8b', '7baacdbb-e003-4588-8301-1a81d8a2e7c0', '8b9e3d77-0502-4b52-8ff6-3e70cec98efd'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:43 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:43 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:43 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 -F qcow2 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa" returned: 0 in 0.871s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:43 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa is being set with open permissions: ugo+rw
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:43 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa
Jul 02 05:06:43 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" acquired by "delete_volume" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce9b434-4536-4581-ad0f-039dc4da2e11]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:43 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:43 devstack sudo[104557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b
Jul 02 05:06:43 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:44 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.802s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:44 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-02de9abc-b0c1-4706-b7f1-b0eb8cc98efd tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-f15425f7-540f-4e33-a3c6-3a47f74aabed-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:44 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa" returned: 0 in 0.803s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:44 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info
Jul 02 05:06:44 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:44 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" returned: 0 in 0.840s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:44 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:44 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b
Jul 02 05:06:44 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:45 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info" returned: 0 in 0.652s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:45 devstack cinder-volume[86158]: WARNING cinder.volume.drivers.remotefs [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info is being set with open permissions: ugo+rw
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:45 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info
Jul 02 05:06:45 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:45 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" returned: 0 in 0.640s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b" released by "delete_volume" :: held 1.536s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['7d45e0ae-6462-40ab-bd80-11b5e0c8c33a', '4b98378b-a89a-44d5-b41c-165da509151c', 'b2f08b9d-6576-4377-a934-f659091cc9a1', '65941e9c-5048-4c6a-9d00-830a2223d716'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:45 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:45 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:45 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.info" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.963s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.795s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x777ab29a4da0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b530b7-cca5-4ddc-821d-19c47980f3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b588dc311e1e4ed6bfdc7cdd84ba7085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T03:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T03:06:36Z,use_quota=True,user_id='ba8dbf363cb046c99a321d49f6ec4360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(986b1e2b-57a2-4a6b-8045-83bbfe137b2d),volume_type_id=986b1e2b-57a2-4a6b-8045-83bbfe137b2d)}" {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Creating volume e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Selected osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e as target Quobyte volume. {{(pid=86158) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 02 05:06:45 devstack cinder-volume[86158]: INFO cinder.volume.drivers.remotefs [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] casted to osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1073741824 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:45 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1073741824
Jul 02 05:06:45 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:45 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-3d883a02-fc21-4629-a348-bcb51ced9bb1 tempest-CinderUnicodeTest-244983685 None] Create snapshot completed successfully
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-77092eaa-6d81-4c8e-b1b7-7209e7025a41-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-77092eaa-6d81-4c8e-b1b7-7209e7025a41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-77092eaa-6d81-4c8e-b1b7-7209e7025a41" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:45 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-77092eaa-6d81-4c8e-b1b7-7209e7025a41" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6be46-4ea5-469c-bb0e-72f08aa32094]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:46 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41
Jul 02 05:06:46 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:46 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.693s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:46 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-e16a4a68-161f-4e83-a890-b4b43ba64040 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-8a18b72a-ef70-4b8e-942f-f0d0a7d5678b-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-62184eb4-97cf-4a22-9eb2-bea60a72bdaa-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-62184eb4-97cf-4a22-9eb2-bea60a72bdaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-quobyte-62184eb4-97cf-4a22-9eb2-bea60a72bdaa" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-62184eb4-97cf-4a22-9eb2-bea60a72bdaa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Deleting offline snapshot 62184eb4-97cf-4a22-9eb2-bea60a72bdaa of volume 0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] snapshot_file for this snap is: volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[663fb74f-7f97-425a-a1d4-c5e2aff7a427]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:46 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1073741824" returned: 0 in 0.874s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:46 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:46 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:46 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa
Jul 02 05:06:46 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:46 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41" returned: 0 in 0.829s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:46 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:46 devstack sudo[104592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41
Jul 02 05:06:46 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:47 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 0 in 0.639s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'} {{(pid=86158) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Attempting download of fac2c478-76a3-43db-b1a5-748c801c35dd ((None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}])) to volume e3b530b7-cca5-4ddc-821d-19c47980f3e2. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e46a96-ca7b-467e-a05e-9e883a0d492b]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:47 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa" returned: 0 in 0.791s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0669005b-cffe-4982-a14c-45ca46cfc1a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0711a-257e-4262-8695-dc5bca52ed3f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:47 devstack sudo[104598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf
Jul 02 05:06:47 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:47 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-77092eaa-6d81-4c8e-b1b7-7209e7025a41" returned: 0 in 0.686s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-77092eaa-6d81-4c8e-b1b7-7209e7025a41" released by "delete_volume" :: held 1.559s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:47 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8
Jul 02 05:06:47 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['e201be00-6793-4c8f-9b26-4fa94c7be0d1', '940f9bd7-c98b-41a7-9b92-86d9f0af63cd', '7c3871d6-bc14-470c-a62a-746582ba0b75', 'dba66852-24ce-4b73-8705-3a96e1f182ec'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:47 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:47 devstack sudo[104603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:47 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-309f6789-218c-432c-a82a-84d5a179bacf-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-309f6789-218c-432c-a82a-84d5a179bacf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:48 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf" returned: 0 in 0.833s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-309f6789-218c-432c-a82a-84d5a179bacf" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:48 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8" returned: 0 in 0.857s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-309f6789-218c-432c-a82a-84d5a179bacf" acquired by "delete_volume" :: waited 0.031s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:48 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa
Jul 02 05:06:48 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb72e53-0ff5-49f6-b971-1ec6fe7f69ef]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:48 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf
Jul 02 05:06:48 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:48 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.722s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:48 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:48 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-eec23e23-4f10-4449-a282-c19dd87fbbbc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-77092eaa-6d81-4c8e-b1b7-7209e7025a41-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:48 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf
Jul 02 05:06:48 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:49 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf" returned: 1 in 0.859s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fac2c478-76a3-43db-b1a5-748c801c35dd_7kx6thmf' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b30a6e-7634-4b7b-a0c9-b705db9ac4cd]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:49 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa" returned: 0 in 0.855s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:49 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf" returned: 0 in 0.834s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:49 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa
Jul 02 05:06:49 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:49 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:49 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:49 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf
Jul 02 05:06:49 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:49 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:49 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-309f6789-218c-432c-a82a-84d5a179bacf" returned: 0 in 0.679s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8.62184eb4-97cf-4a22-9eb2-bea60a72bdaa" returned: 0 in 0.718s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-309f6789-218c-432c-a82a-84d5a179bacf" released by "delete_volume" :: held 1.565s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-62184eb4-97cf-4a22-9eb2-bea60a72bdaa" released by "_delete_snapshot" :: held 3.340s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" released by "delete_snapshot" :: held 3.368s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['812231c8-a236-40f1-9b14-204dbe31ee8e', '5ef46400-f2b0-46de-98f6-b8a570a47339', '80082213-27f2-4ba4-9172-40603adf6a16', '27583040-2f87-4ad3-b468-aa87efac2f3b'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:49 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD
Jul 02 05:06:49 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:49 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Created reservations ['433abb90-d0ef-4859-82d4-a3c76eb60199', '501090d6-abaa-430e-a9b9-6d4f05f690e3', 'c6b72a47-8307-42b5-898e-43eeaad611b1', '7e400b84-2e3b-42f0-bd04-f39064a745be'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:50 devstack sudo[104644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:50 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:50 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Delete snapshot completed successfully.
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-da333ff1-36ae-4b01-8cfa-59357bf2ea5f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-62184eb4-97cf-4a22-9eb2-bea60a72bdaa-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-693819dd-81b0-4fde-8206-85544be32190-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-693819dd-81b0-4fde-8206-85544be32190-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-693819dd-81b0-4fde-8206-85544be32190" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-693819dd-81b0-4fde-8206-85544be32190" acquired by "delete_volume" :: waited 0.029s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[5300ebe8-12be-4968-8f2e-03306ab1be3f]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:50 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] fac2c478-76a3-43db-b1a5-748c801c35dd was raw, converting to raw {{(pid=86158) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:50 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:50 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:50 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190
Jul 02 05:06:50 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-0669005b-cffe-4982-a14c-45ca46cfc1a8-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-0669005b-cffe-4982-a14c-45ca46cfc1a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:50 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.847s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:50 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" acquired by "delete_volume" :: waited 0.022s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[6036ed3a-ef40-4d30-9059-ebba86eeca37]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:50 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-23c59055-e690-405e-b570-1eb62f2803a6 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-309f6789-218c-432c-a82a-84d5a179bacf-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:51 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8
Jul 02 05:06:51 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:51 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190" returned: 0 in 0.969s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:51 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 0 in 0.906s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fac2c478-76a3-43db-b1a5-748c801c35dd_fg4en1didevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 02 05:06:51 devstack cinder-volume[86158]: INFO cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Converted 0.00 MB image at 0.00 MB/s
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1G {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:51 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190
Jul 02 05:06:51 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:51 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1G
Jul 02 05:06:51 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:51 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8" returned: 0 in 0.896s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:51 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:51 devstack sudo[104706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:51 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:51 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8
Jul 02 05:06:51 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:52 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-693819dd-81b0-4fde-8206-85544be32190" returned: 0 in 0.696s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-693819dd-81b0-4fde-8206-85544be32190" released by "delete_volume" :: held 1.708s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['20d1b54e-ad27-4ed1-ab30-af58e7aaf8d3', '3b7ea028-5cfc-418d-808e-f4257ac69ffe', 'ede91340-5cd2-4c1b-bbb2-10df9bab16cf', '036843b7-78b8-419b-9f1a-516e910c0987'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:52 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 1G" returned: 0 in 0.757s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6764b5-ce8d-4629-b94c-45867eb18db4]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:52 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:52 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:52 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:52 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:52 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-0669005b-cffe-4982-a14c-45ca46cfc1a8" returned: 0 in 0.738s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:52 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.809s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-0669005b-cffe-4982-a14c-45ca46cfc1a8" released by "delete_volume" :: held 1.767s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_service.periodic_task [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] Running periodic task VolumeManager._thread_info {{(pid=86158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread count: 28 {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-ea3cdd98-7044-4e19-b497-8b4a21fb4220 None None] thread info: [<_MainThread(MainThread, started 131368976339072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131368867331136)>, <Thread(Thread-3 (stat_writer), started daemon 131368865649280)>, <Thread(Rabbit-heartbeat, started daemon 131368864541632)>, <Thread(Thread-5 (_runner), started daemon 131368864741504)>, <Thread(Thread-7 (_runner), started daemon 131368862746240)>, <Thread(fd_logger, started daemon 131368862409664)>, <Thread(privsep_reader, started daemon 131368862413568)>, <Thread(tpool_thread_0, started daemon 131368852166336)>, <Thread(tpool_thread_1, started daemon 131368843773632)>, <Thread(tpool_thread_2, started daemon 131368835380928)>, <Thread(tpool_thread_3, started daemon 131368826988224)>, <Thread(tpool_thread_4, started daemon 131368818579136)>, <Thread(tpool_thread_5, started daemon 131368810170048)>, <Thread(tpool_thread_6, started daemon 131368801760960)>, <Thread(tpool_thread_7, started daemon 131368793351872)>, <Thread(tpool_thread_8, started daemon 131368784942784)>, <Thread(tpool_thread_9, started daemon 131368776533696)>, <Thread(tpool_thread_10, started daemon 131368768124608)>, <Thread(tpool_thread_11, started daemon 131368759715520)>, <Thread(tpool_thread_12, started daemon 131368751306432)>, <Thread(tpool_thread_13, started daemon 131368742897344)>, <Thread(tpool_thread_14, started daemon 131368734488256)>, <Thread(tpool_thread_15, started daemon 131368726079168)>, <Thread(tpool_thread_16, started daemon 131368717670080)>, <Thread(tpool_thread_17, started daemon 131368709260992)>, <Thread(tpool_thread_18, started daemon 131368700851904)>, <Thread(tpool_thread_19, started daemon 131368692442816)>] {{(pid=86158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-4452d332-2e74-400d-9c91-764e59015fa0-delete_snapshot" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Created reservations ['0a284b3f-a5c0-4fb3-b2a7-b7cb8328f03f', 'a6e0baea-c8f5-4249-9f09-3d84820edb35', 'a12404a6-76f4-43a0-985d-3669c86a8706', '7f807268-763a-4db6-afa0-d1549ba187fa'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-4452d332-2e74-400d-9c91-764e59015fa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" by "delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-4452d332-2e74-400d-9c91-764e59015fa0" by "_delete_snapshot" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-4452d332-2e74-400d-9c91-764e59015fa0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleting offline snapshot 4452d332-2e74-400d-9c91-764e59015fa0 of volume 47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] snapshot_file for this snap is: volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[59527ed6-8661-4b6b-98f1-b49cc6bb27be]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:52 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:52 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:52 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:53 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0
Jul 02 05:06:53 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-a51244c6-2f6d-425d-943b-3673587bc95c-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "cinder-a51244c6-2f6d-425d-943b-3673587bc95c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Acquiring lock "cinder-quobyte-a51244c6-2f6d-425d-943b-3673587bc95c" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-a51244c6-2f6d-425d-943b-3673587bc95c" acquired by "delete_volume" :: waited 0.021s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:53 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.842s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[66512556-4861-4dc5-9846-28b25f2729b5]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-96518306-df99-4cd7-ad4f-dd5b71806ebc tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-693819dd-81b0-4fde-8206-85544be32190-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:53 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c
Jul 02 05:06:53 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:53 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 0 in 1.149s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:53 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:53 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:53 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.908s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:53 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Deleted volume successfully.
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-4c156947-4648-4644-9c98-c9471aafb13f tempest-CinderUnicodeTest-244983685 None] Lock "cinder-0669005b-cffe-4982-a14c-45ca46cfc1a8-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:53 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0" returned: 0 in 0.992s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86158) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2eeac-b2cd-452b-ad14-53cc40b73ae1]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:53 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:54 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8
Jul 02 05:06:54 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:54 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c" returned: 0 in 0.821s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:54 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c
Jul 02 05:06:54 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:54 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 1 in 0.864s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Downloaded image fac2c478-76a3-43db-b1a5-748c801c35dd ((None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}])) to volume e3b530b7-cca5-4ddc-821d-19c47980f3e2 successfully. {{(pid=86158) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.image.image_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Temporary image fac2c478-76a3-43db-b1a5-748c801c35dd for user ba8dbf363cb046c99a321d49f6ec4360 is deleted. {{(pid=86158) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.volume_utils [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Marking volume e3b530b7-cca5-4ddc-821d-19c47980f3e2 as bootable. {{(pid=86158) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Copying metadata from image fac2c478-76a3-43db-b1a5-748c801c35dd to e3b530b7-cca5-4ddc-821d-19c47980f3e2. {{(pid=86158) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Creating volume glance metadata for volume e3b530b7-cca5-4ddc-821d-19c47980f3e2 backed by image fac2c478-76a3-43db-b1a5-748c801c35dd with: {'image_id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '98b71b159e1f4eff448c5292ba6eb55a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86158) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ef134d-0f76-49f7-9f06-177c373b86c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2', 'volume_size': 1, 'image_id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fac2c478-76a3-43db-b1a5-748c801c35dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98b71b159e1f4eff448c5292ba6eb55a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b588dc311e1e4ed6bfdc7cdd84ba7085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edef30a82e1f63eb0ae2678d4ce99e5ff245833a3b65adc0c131ee66c449209d1ff734a9e19f81ceff2f73e38e9729dcb0d98830b99c2a65edb0e96eb50c9625', 'id': 'fac2c478-76a3-43db-b1a5-748c801c35dd', 'created_at': datetime.datetime(2026, 7, 2, 3, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 3, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fac2c478-76a3-43db-b1a5-748c801c35dd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x777ab25f40b0>}' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa4cf90-bf0e-43c9-b7e1-10f87320089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 02 05:06:54 devstack cinder-volume[86158]: INFO cinder.volume.flows.manager.create_volume [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Volume volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 (e3b530b7-cca5-4ddc-821d-19c47980f3e2): created successfully
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa4cf90-bf0e-43c9-b7e1-10f87320089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86158) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Flow 'volume_create_manager' (0e3d84c6-f561-47e3-90f8-efee4a149264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86158) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 02 05:06:54 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-514428c1-d8ec-4e0a-a7a7-7b17972413f2 tempest-VolumeImageDependencyTests-747881399 None] Created volume successfully.
Jul 02 05:06:54 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8" returned: 0 in 0.780s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:54 devstack sudo[104750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0
Jul 02 05:06:54 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:54 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-a51244c6-2f6d-425d-943b-3673587bc95c" returned: 0 in 0.689s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "cinder-quobyte-a51244c6-2f6d-425d-943b-3673587bc95c" released by "delete_volume" :: held 1.570s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Created reservations ['01ec25a0-d300-403a-a9d1-0129ba84a5bd', '3fbedf7c-baee-4456-ae18-304a2077cefd', '3f6884ab-57f4-4f0a-b310-3b6c89dc7781', '6243bdf7-5906-4d77-b73d-f1788ce0ffe9'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:54 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:54 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:54 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Acquiring lock "cinder-e3b530b7-cca5-4ddc-821d-19c47980f3e2-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "cinder-e3b530b7-cca5-4ddc-821d-19c47980f3e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Acquiring lock "cinder-quobyte-e3b530b7-cca5-4ddc-821d-19c47980f3e2" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "cinder-quobyte-e3b530b7-cca5-4ddc-821d-19c47980f3e2" acquired by "delete_volume" :: waited 0.017s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec8311c-5aea-4787-994e-c41b01a39ddd]: (4, 'raw') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:55 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0" returned: 0 in 0.896s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:55 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0
Jul 02 05:06:55 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:55 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:55 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:55 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.727s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:55 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Deleted volume successfully.
Jul 02 05:06:55 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-b3910057-981d-4c3b-85b0-77ace8f8208e tempest-CinderUnicodeTest-244983685 None] Lock "cinder-a51244c6-2f6d-425d-943b-3673587bc95c-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:56 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8.4452d332-2e74-400d-9c91-764e59015fa0" returned: 0 in 0.712s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-4452d332-2e74-400d-9c91-764e59015fa0" released by "_delete_snapshot" :: held 3.497s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" released by "delete_snapshot" :: held 3.538s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:56 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 0 in 0.879s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['7cc234ae-2096-4589-a232-032fcbf186b9', '4a3732ff-28ba-4b11-bfd4-1401516312f2', '9faa3289-c770-443f-8ff6-fd4e333648bd', '412e39b6-f385-49d6-9b3e-549acde34493'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:56 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Delete snapshot completed successfully.
Jul 02 05:06:56 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:56 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-0a0f7958-ba62-4c77-a390-297302456a99 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-4452d332-2e74-400d-9c91-764e59015fa0-delete_snapshot" released by "delete_snapshot" :: held 3.724s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-47b206ac-dfe3-434b-aa6c-68c19a4bada8-delete_volume" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:56 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-47b206ac-dfe3-434b-aa6c-68c19a4bada8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" by "delete_volume" {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" acquired by "delete_volume" :: waited 0.018s {{(pid=86158) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c73a0-b873-420a-886c-078993938dcc]: (4, 'qcow2') {{(pid=87057) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:57 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 1 in 0.837s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2' failed. Not Retrying. {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:57 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8
Jul 02 05:06:57 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:57 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2
Jul 02 05:06:57 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:57 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-e3b530b7-cca5-4ddc-821d-19c47980f3e2" returned: 0 in 0.673s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "cinder-quobyte-e3b530b7-cca5-4ddc-821d-19c47980f3e2" released by "delete_volume" :: held 2.459s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:57 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8" returned: 0 in 0.793s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:57 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8
Jul 02 05:06:57 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:57 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Created reservations ['4354ecd2-68f2-460d-8df5-cd6f0226d983', '82a3d587-2c5f-49b9-94a0-48f89db9f8e7', '6e845304-f19e-4b2e-b023-d579f0dfc773', '5f98d0f6-174c-45e4-9eb9-f2168f93562e'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:58 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:58 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:58 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18/volume-47b206ac-dfe3-434b-aa6c-68c19a4bada8" returned: 0 in 0.631s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-quobyte-47b206ac-dfe3-434b-aa6c-68c19a4bada8" released by "delete_volume" :: held 1.508s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.quota [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Created reservations ['04304cdd-6d2f-4065-a06b-27857973e411', 'd497e1dc-df49-49cd-8ec3-381508805cf7', '8a8c7b73-67bf-4fb1-8ecd-957255919e1d', 'c6a39d00-6899-4f6a-b100-03c3b9fffcf1'] {{(pid=86158) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 02 05:06:58 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.664s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e': None} {{(pid=86158) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.volume.drivers.quobyte [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2aac6975-5873-4216-b4b0-c61f70f5d67e'] {{(pid=86158) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.lockutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86158) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18 {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 02 05:06:58 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Deleted volume successfully.
Jul 02 05:06:58 devstack sudo[104785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18
Jul 02 05:06:58 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 02 05:06:58 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-97183844-fa82-40db-a0e3-3434cf9bebdb tempest-VolumeImageDependencyTests-747881399 None] Lock "cinder-e3b530b7-cca5-4ddc-821d-19c47980f3e2-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:06:59 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root
Jul 02 05:06:59 devstack cinder-volume[86158]: DEBUG oslo_concurrency.processutils [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d748f61f6cc4d829561a7de516ed4d18" returned: 0 in 0.714s {{(pid=86158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 02 05:06:59 devstack cinder-volume[86158]: DEBUG cinder.manager [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Notifying Schedulers of capabilities ... {{(pid=86158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 02 05:06:59 devstack cinder-volume[86158]: INFO cinder.volume.manager [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Deleted volume successfully.
Jul 02 05:06:59 devstack cinder-volume[86158]: DEBUG cinder.coordination [None req-5eaed4ed-5444-414c-bfb1-3c55f45c83d8 tempest-CreateVolumesFromSnapshotTest-191474396 None] Lock "cinder-47b206ac-dfe3-434b-aa6c-68c19a4bada8-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86158) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 02 05:07:08 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:UPDATE=158,cinder:INSERT=48,cinder:SELECT=114,cinder:DELETE=11 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 02 05:07:09 devstack cinder-volume[86158]: DEBUG dbcounter [-] [86158] Writing DB stats cinder:SELECT=113,cinder:UPDATE=156,cinder:DELETE=14,cinder:INSERT=39 {{(pid=86158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}